Jul 13 21:09:20.547520 ip-10-0-133-136 systemd[1]: Starting Kubernetes Kubelet... Jul 13 21:09:20.997784 ip-10-0-133-136 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 21:09:20.997784 ip-10-0-133-136 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 21:09:20.997784 ip-10-0-133-136 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 21:09:20.997784 ip-10-0-133-136 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 21:09:20.997784 ip-10-0-133-136 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 21:09:20.997784 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:20.990483 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 21:09:20.997784 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996621 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 21:09:20.997784 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996639 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 21:09:20.997784 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996642 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 21:09:20.997784 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996647 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 21:09:20.997784 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996651 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 21:09:20.997784 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996656 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 21:09:20.997784 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996663 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 21:09:20.997784 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996666 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996669 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996673 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996676 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996679 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996682 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996685 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996689 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996692 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996695 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996698 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996701 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996706 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996709 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996719 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996722 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996725 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996728 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996731 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996734 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 21:09:20.999121 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996736 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996739 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996742 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996745 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996749 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996754 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996757 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996760 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996763 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996766 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996769 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996772 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996775 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996777 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996780 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996783 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996786 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996791 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996794 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996796 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 21:09:21.000011 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996799 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996804 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996808 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996813 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996816 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996822 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996825 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996833 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996836 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996841 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996844 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996847 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996850 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996866 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996869 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996872 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996875 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996878 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996881 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 21:09:21.001145 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996884 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996886 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996889 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996894 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996898 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996900 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996903 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996906 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996909 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996912 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996915 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996918 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996921 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996928 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996932 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996937 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996940 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996944 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996948 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996951 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 21:09:21.002059 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996954 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 21:09:21.003177 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996963 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 21:09:21.003177 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996966 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 21:09:21.003177 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996969 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 21:09:21.003177 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996972 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 21:09:21.003177 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996977 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 21:09:21.003177 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996981 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 21:09:21.003177 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996987 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 21:09:21.003177 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996991 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 21:09:21.003177 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996995 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 21:09:21.003177 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.996999 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 21:09:21.003177 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.997002 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 21:09:21.003177 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:20.997006 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021623 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021647 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021651 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021654 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021657 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021660 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021662 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021667 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021670 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021675 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021678 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021682 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021685 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021688 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021692 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021694 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021699 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021702 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021705 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 21:09:21.068977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021708 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021710 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021714 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021717 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021722 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021728 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021731 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021733 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021740 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021746 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021750 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021754 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021757 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021762 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021765 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021767 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021772 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021775 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021779 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021782 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 21:09:21.070419 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021785 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021789 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021791 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021794 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021796 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021801 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021803 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021808 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021811 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021813 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021820 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021823 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021828 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021831 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021836 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021841 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021843 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021849 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021885 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 21:09:21.071384 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021901 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021904 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021908 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021912 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021914 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021918 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021921 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021924 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021927 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021930 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021932 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021936 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021940 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021945 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021951 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021955 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021958 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021961 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021964 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021967 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 21:09:21.072554 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021970 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021972 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021975 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021978 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021980 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021984 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021987 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021989 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021992 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.021996 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022000 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022003 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022006 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022009 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022011 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022014 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022016 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022019 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022022 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022025 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 21:09:21.077501 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022028 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022466 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022471 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022474 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022477 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022480 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022485 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022489 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022492 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022495 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022498 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022501 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022503 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022506 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022509 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022512 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022514 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022517 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022519 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 21:09:21.078454 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022522 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022524 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022527 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022530 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022533 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022535 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022538 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022541 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022543 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022546 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022548 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022551 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022553 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022556 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022558 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022561 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022563 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022566 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022568 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022572 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 21:09:21.079656 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022575 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022577 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022580 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022582 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022585 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022589 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022593 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022595 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022598 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022601 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022603 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022606 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022608 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022611 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022614 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022617 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022619 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022622 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022625 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 21:09:21.081557 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022628 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022630 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022633 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022635 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022638 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022641 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022644 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022647 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022650 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022653 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022656 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022659 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022661 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022665 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022668 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022670 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022672 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022675 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022678 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022680 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 21:09:21.082753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022683 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022686 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022688 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022691 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022693 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022696 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022698 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022701 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022703 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022706 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022710 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022712 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022715 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022718 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022720 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022723 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022726 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022729 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022731 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022734 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 21:09:21.083714 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022736 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.022738 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022818 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022826 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022833 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022838 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022843 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022847 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022852 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022873 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022877 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022880 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022884 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022887 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022890 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022893 2576 flags.go:64] FLAG: --cgroup-root="" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022896 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022899 2576 flags.go:64] FLAG: --client-ca-file="" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022902 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022905 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022911 2576 flags.go:64] FLAG: --cluster-domain="" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022914 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022918 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022921 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 21:09:21.086346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022924 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022929 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022932 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022935 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022939 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022942 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022945 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022948 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022951 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022954 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022959 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022963 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022966 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022969 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022972 2576 flags.go:64] FLAG: --enable-server="true" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022976 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022981 2576 flags.go:64] FLAG: --event-burst="100" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022984 2576 flags.go:64] FLAG: --event-qps="50" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022987 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022990 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022993 2576 flags.go:64] FLAG: --eviction-hard="" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.022997 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023000 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023003 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023006 2576 flags.go:64] FLAG: --eviction-soft="" Jul 13 21:09:21.087509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023009 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023012 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023016 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023019 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023021 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023024 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023027 2576 flags.go:64] FLAG: --feature-gates="" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023031 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023035 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023038 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023041 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023045 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023048 2576 flags.go:64] FLAG: --help="false" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023051 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023054 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023057 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023060 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023063 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023066 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023069 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023072 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023076 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023078 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 21:09:21.089417 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023082 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023085 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023088 2576 flags.go:64] FLAG: --kube-reserved="" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023091 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023094 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023100 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023103 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023106 2576 flags.go:64] FLAG: --lock-file="" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023109 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023111 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023114 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023121 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023124 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023126 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023129 2576 flags.go:64] FLAG: --logging-format="text" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023132 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023136 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023139 2576 flags.go:64] FLAG: --manifest-url="" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023142 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023146 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023149 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023153 2576 flags.go:64] FLAG: --max-pods="110" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023156 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023159 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023162 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 21:09:21.090651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023165 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023169 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023172 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023175 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023183 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023186 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023189 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023192 2576 flags.go:64] FLAG: --pod-cidr="" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023196 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023201 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023205 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023208 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023212 2576 flags.go:64] FLAG: --port="10250" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023215 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023218 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e07fc8356a5aead6" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023221 2576 flags.go:64] FLAG: --qos-reserved="" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023224 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023228 2576 flags.go:64] FLAG: --register-node="true" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023231 2576 flags.go:64] FLAG: --register-with-taints="" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023234 2576 flags.go:64] FLAG: --registry-burst="10" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023237 2576 flags.go:64] FLAG: --registry-qps="5" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023240 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023243 2576 flags.go:64] FLAG: --reserved-memory="" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023247 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023250 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 21:09:21.092803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023254 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023257 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023259 2576 flags.go:64] FLAG: --runonce="false" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023262 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023265 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023268 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023271 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023274 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023278 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023281 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023284 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023287 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023290 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023293 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023296 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023299 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023303 2576 flags.go:64] FLAG: --system-cgroups="" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023306 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023311 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023315 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023318 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023323 2576 flags.go:64] FLAG: --tls-min-version="" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023325 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023330 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023333 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 21:09:21.094252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023336 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 21:09:21.094379 ip-10-0-133-136 systemd[1]: Started Kubernetes Kubelet. Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023339 2576 flags.go:64] FLAG: --v="2" Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023343 2576 flags.go:64] FLAG: --version="false" Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023347 2576 flags.go:64] FLAG: --vmodule="" Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023351 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023354 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023494 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023498 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023501 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023504 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023508 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023511 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023516 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023519 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023523 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023526 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023529 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023532 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023535 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023538 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 21:09:21.095562 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023541 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023544 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023547 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023549 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023553 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023555 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023560 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023563 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023566 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023568 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023573 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023575 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023578 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023580 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023583 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023586 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023588 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023591 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023594 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023596 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 21:09:21.096753 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023599 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023601 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023604 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023607 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023610 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023612 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023615 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023618 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023620 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023623 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023625 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023628 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023630 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023633 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023635 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023638 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023641 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023644 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023649 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 21:09:21.097722 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023652 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023655 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023657 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023662 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023665 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023668 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023670 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023674 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023676 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023679 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023682 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023684 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023687 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023689 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023692 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023694 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023697 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023700 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023702 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023705 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 21:09:21.098702 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023708 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023711 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023714 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023716 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023719 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023722 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023724 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023727 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023730 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023732 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023735 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023740 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023744 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023748 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023751 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023755 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023759 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023762 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023765 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023768 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 21:09:21.099661 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023771 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 21:09:21.100789 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023773 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 21:09:21.100789 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023776 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 21:09:21.100789 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023779 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 21:09:21.100789 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023782 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 21:09:21.100789 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.023785 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 21:09:21.100789 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.023794 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 21:09:21.100789 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.030980 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 21:09:21.100789 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.031003 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 21:09:21.100789 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.031023 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 21:09:21.100789 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.031033 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 21:09:21.100789 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031092 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 21:09:21.100789 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031098 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 21:09:21.100789 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031102 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 21:09:21.100789 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031105 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031108 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031111 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031114 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031116 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031119 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031122 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031125 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031127 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031130 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031133 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031136 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031138 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031141 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031144 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031146 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031152 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031155 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031157 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031160 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 21:09:21.101517 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031162 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031165 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031168 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031176 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031180 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031183 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031188 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031191 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031193 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031196 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031199 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031201 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031204 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031208 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031212 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031215 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031217 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031220 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031223 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 21:09:21.102484 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031225 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031228 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031231 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031233 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031236 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031239 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031242 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031244 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031247 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031254 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031257 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031259 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031262 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031265 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031268 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031272 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031277 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031280 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031283 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 21:09:21.103485 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031287 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031290 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031292 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031295 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031298 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031300 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031303 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031305 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031308 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031310 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031313 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031315 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031318 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031321 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031323 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031325 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031328 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031331 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031334 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031336 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 21:09:21.104437 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031339 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031341 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031345 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031347 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031350 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031353 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031355 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031358 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031360 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031364 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031367 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031370 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031372 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031375 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031378 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031381 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031383 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 21:09:21.106326 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031385 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 21:09:21.107262 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.031391 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 21:09:21.107262 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031518 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 21:09:21.107262 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031522 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 21:09:21.107262 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031525 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 21:09:21.107262 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031528 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 21:09:21.107262 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031531 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 21:09:21.107262 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031534 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 21:09:21.107262 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031536 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 21:09:21.107262 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031539 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 21:09:21.107262 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031542 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 21:09:21.107262 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031545 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 21:09:21.107262 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031547 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 21:09:21.107262 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031550 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 21:09:21.107262 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031553 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 21:09:21.107262 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031555 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031558 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031562 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031564 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031567 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031571 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031575 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031577 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031580 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031583 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031587 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031590 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031593 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031595 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031598 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031601 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031604 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031606 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031609 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 21:09:21.109396 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031611 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031614 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031616 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031619 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031621 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031624 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031627 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031629 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031633 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031637 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031640 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031643 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031646 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031649 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031651 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031655 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031658 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031660 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031663 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 21:09:21.110372 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031665 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031668 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031670 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031673 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031677 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031680 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031683 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031685 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031688 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031691 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031694 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031697 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031699 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031702 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031704 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031707 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031709 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031712 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031715 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031717 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 21:09:21.213246 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031719 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031722 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031724 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031727 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031729 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031732 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031735 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031737 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031741 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031744 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031746 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031749 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031751 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031754 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031756 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031759 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031763 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031766 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031768 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031771 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 21:09:21.214561 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031774 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 21:09:21.215920 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031776 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 21:09:21.215920 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031780 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 21:09:21.215920 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031783 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 21:09:21.215920 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031786 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 21:09:21.215920 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031789 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 21:09:21.215920 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031791 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 21:09:21.215920 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:21.031794 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 21:09:21.215920 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.031799 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 21:09:21.215920 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.031973 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 21:09:21.215920 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.034110 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 21:09:21.215920 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.035293 2576 server.go:1019] "Starting client certificate rotation" Jul 13 21:09:21.215920 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.035391 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 21:09:21.215920 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.035433 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 21:09:21.216843 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.037709 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 21:09:21.216843 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.042688 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 21:09:21.216843 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.054433 2576 log.go:25] "Validated CRI v1 runtime API" Jul 13 21:09:21.216843 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.056374 2576 log.go:25] "Validated CRI v1 image API" Jul 13 21:09:21.216843 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.058617 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 21:09:21.216843 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.062902 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 21:09:21.216843 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.063050 2576 fs.go:135] Filesystem UUIDs: map[4733428d-81bb-4b8b-bb9e-a3044d476241:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 eb34a502-9513-4360-a171-aba89f4dd683:/dev/nvme0n1p3] Jul 13 21:09:21.216843 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.063069 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.069047 2576 manager.go:216] Machine: {Timestamp:2026-07-13 21:09:21.067706246 +0000 UTC m=+0.400370682 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3072579 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b5e74d67073f982200904c67a6859 SystemUUID:ec2b5e74-d670-73f9-8220-0904c67a6859 BootID:ff6bc30d-de6c-4855-9d72-550e92831e01 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ed:db:55:80:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ed:db:55:80:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:62:07:38:1d:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.069160 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.069254 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.070633 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.070666 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-136.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.072004 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.072017 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.072026 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.072723 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.073797 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.077984 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.078127 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.078159 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.078170 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.078187 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.078196 2576 kubelet.go:398] "Adding apiserver pod source" Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.078214 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 21:09:21.218488 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.078616 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.078632 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.081750 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.083203 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.083237 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.083811 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.083826 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.083832 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.083839 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.083847 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.083853 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.084003 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.084010 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.084018 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.084023 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.084032 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.084041 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.085504 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.085512 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.087484 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-136.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.088028 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.088029 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-136.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.089298 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-67f5d" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.089342 2576 server.go:1268] "Started kubelet" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.089412 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.089593 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.089671 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.095242 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-67f5d" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.095381 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.097072 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.097236 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.098668 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-136.ec2.internal.18c1f5981d359fc5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-136.ec2.internal,UID:ip-10-0-133-136.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-136.ec2.internal,},FirstTimestamp:2026-07-13 21:09:21.089314757 +0000 UTC m=+0.421979192,LastTimestamp:2026-07-13 21:09:21.089314757 +0000 UTC m=+0.421979192,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-136.ec2.internal,}" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.102083 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.102104 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.102229 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-136.ec2.internal\" not found" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.102651 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.102690 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.102701 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.102854 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 13 21:09:21.219658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.102878 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.105086 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-136.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.105205 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.105376 2576 factory.go:55] Registering systemd factory Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.105393 2576 factory.go:223] Registration of the systemd container factory successfully Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.106184 2576 factory.go:153] Registering CRI-O factory Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.106250 2576 factory.go:223] Registration of the crio container factory successfully Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.106297 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.106322 2576 factory.go:103] Registering Raw factory Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.106334 2576 manager.go:1196] Started watching for new ooms in manager Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.106952 2576 manager.go:349] Starting recovery of all containers Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.118603 2576 manager.go:354] Recovery completed Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.123296 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.125690 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasSufficientMemory" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.125720 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.125732 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasSufficientPID" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.126377 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.126390 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.126411 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.126428 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.128746 2576 policy_none.go:49] "None policy: Start" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.128761 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.128773 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.128885 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasSufficientMemory" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.128912 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.128927 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasSufficientPID" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.130961 2576 policy_none.go:47] "Start" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.193726 2576 manager.go:337] "Starting Device Plugin manager" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.193765 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.193780 2576 server.go:87] "Starting device plugin registration server" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.194147 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.194162 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.194351 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.194434 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.194443 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.195067 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 21:09:21.221362 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.195125 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-136.ec2.internal\" not found" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.272057 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.273384 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.273423 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.273451 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.273499 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.275660 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.294691 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.295737 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasSufficientMemory" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.295773 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.295785 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasSufficientPID" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.295811 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.304169 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.304190 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-136.ec2.internal\": node \"ip-10-0-133-136.ec2.internal\" not found" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.321243 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-136.ec2.internal\" not found" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.374177 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-136.ec2.internal"] Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.374290 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.376239 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasSufficientMemory" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.376270 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.376280 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasSufficientPID" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.378912 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.379018 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.379050 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.379752 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasSufficientMemory" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.379760 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasSufficientMemory" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.379782 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.379793 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasSufficientPID" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.379768 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.379871 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasSufficientPID" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.382331 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.382356 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.383170 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasSufficientMemory" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.383198 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.383210 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeHasSufficientPID" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.405194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b035606ca1b52c27bd271db4a3fe92ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal\" (UID: \"b035606ca1b52c27bd271db4a3fe92ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.405222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b035606ca1b52c27bd271db4a3fe92ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal\" (UID: \"b035606ca1b52c27bd271db4a3fe92ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.423827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.405241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/54563f63446557ad0a7d2b139842ad20-config\") pod \"kube-apiserver-proxy-ip-10-0-133-136.ec2.internal\" (UID: \"54563f63446557ad0a7d2b139842ad20\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.426265 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.408647 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-136.ec2.internal\" not found" node="ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.426265 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.412518 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-136.ec2.internal\" not found" node="ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.426265 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.421287 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-136.ec2.internal\" not found" Jul 13 21:09:21.620759 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.505770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b035606ca1b52c27bd271db4a3fe92ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal\" (UID: \"b035606ca1b52c27bd271db4a3fe92ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.620759 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.505800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b035606ca1b52c27bd271db4a3fe92ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal\" (UID: \"b035606ca1b52c27bd271db4a3fe92ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.620759 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.505820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/54563f63446557ad0a7d2b139842ad20-config\") pod \"kube-apiserver-proxy-ip-10-0-133-136.ec2.internal\" (UID: \"54563f63446557ad0a7d2b139842ad20\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.620759 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.505898 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b035606ca1b52c27bd271db4a3fe92ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal\" (UID: \"b035606ca1b52c27bd271db4a3fe92ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.620759 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.505910 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/54563f63446557ad0a7d2b139842ad20-config\") pod \"kube-apiserver-proxy-ip-10-0-133-136.ec2.internal\" (UID: \"54563f63446557ad0a7d2b139842ad20\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.620759 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.505910 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b035606ca1b52c27bd271db4a3fe92ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal\" (UID: \"b035606ca1b52c27bd271db4a3fe92ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.620759 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.522271 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-136.ec2.internal\" not found" Jul 13 21:09:21.624245 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.623193 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-136.ec2.internal\" not found" Jul 13 21:09:21.811811 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.711155 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.811811 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.714911 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-136.ec2.internal" Jul 13 21:09:21.811811 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.723975 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-136.ec2.internal\" not found" Jul 13 21:09:21.825673 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.824985 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-136.ec2.internal\" not found" Jul 13 21:09:21.988136 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:21.925948 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-136.ec2.internal\" not found" Jul 13 21:09:21.990900 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:21.989339 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 21:09:22.166198 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:22.027054 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-136.ec2.internal\" not found" Jul 13 21:09:22.166198 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:22.035453 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 21:09:22.166198 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:22.035579 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 21:09:22.166198 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:22.035588 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 21:09:22.166198 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:22.102179 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 21:04:22 +0000 UTC" deadline="2028-03-07 19:57:30.769497193 +0000 UTC" Jul 13 21:09:22.166198 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:22.102204 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14470h48m8.667295835s" Jul 13 21:09:22.166198 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:22.128005 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-136.ec2.internal\" not found" Jul 13 21:09:22.166198 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:22.139092 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 21:09:22.330736 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:22.203407 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-136.ec2.internal" Jul 13 21:09:22.330736 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:22.213134 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 21:09:22.330736 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:22.214156 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal" Jul 13 21:09:22.330736 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:22.224313 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 21:09:22.330736 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:22.304951 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 21:09:22.396935 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:22.396898 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb035606ca1b52c27bd271db4a3fe92ae.slice/crio-d7a907e87aa65ed8a4b933c75d055962e6ba5dbccc4bd46451df5e19d16bb565 WatchSource:0}: Error finding container d7a907e87aa65ed8a4b933c75d055962e6ba5dbccc4bd46451df5e19d16bb565: Status 404 returned error can't find the container with id d7a907e87aa65ed8a4b933c75d055962e6ba5dbccc4bd46451df5e19d16bb565 Jul 13 21:09:22.401204 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:22.401178 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54563f63446557ad0a7d2b139842ad20.slice/crio-554a1e621b37e53a4b2d665cc7bc7be0af67b912df9f1c73a2902536463ff6d1 WatchSource:0}: Error finding container 554a1e621b37e53a4b2d665cc7bc7be0af67b912df9f1c73a2902536463ff6d1: Status 404 returned error can't find the container with id 554a1e621b37e53a4b2d665cc7bc7be0af67b912df9f1c73a2902536463ff6d1 Jul 13 21:09:22.403685 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:22.403666 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 21:09:22.972772 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:22.972701 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 21:09:23.080164 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.080131 2576 apiserver.go:52] "Watching apiserver" Jul 13 21:09:23.089881 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.089524 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 21:09:23.091585 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.091548 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-ndm6s","openshift-image-registry/node-ca-vv2g9","openshift-multus/multus-additional-cni-plugins-b2ch8","openshift-multus/network-metrics-daemon-lrpd6","openshift-ovn-kubernetes/ovnkube-node-dgjsx","kube-system/global-pull-secret-syncer-5t86b","kube-system/kube-apiserver-proxy-ip-10-0-133-136.ec2.internal","openshift-cluster-node-tuning-operator/tuned-6jbbx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal","openshift-multus/multus-xkzpd","openshift-network-diagnostics/network-check-target-82gqz","openshift-network-operator/iptables-alerter-lnl7m","kube-system/konnectivity-agent-dr48r","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6"] Jul 13 21:09:23.095524 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.094491 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.100556 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.100040 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 21:09:23.100556 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.100263 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-flzzf\"" Jul 13 21:09:23.104510 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.102806 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dr48r" Jul 13 21:09:23.104510 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.103706 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 21:09:23.104510 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.103819 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 21:09:23.104510 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.103853 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 21:09:23.104510 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.103822 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 21:09:23.107175 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.107155 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 21:09:23.107304 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.107284 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.107522 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.107189 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 21:09:23.107704 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.107265 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qh4tz\"" Jul 13 21:09:23.109334 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.109312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:23.109431 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.109400 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:23.110086 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.110065 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 21:09:23.110162 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.110133 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 21:09:23.110162 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.110151 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6q2bl\"" Jul 13 21:09:23.112687 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.112659 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.114796 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.114778 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:23.114926 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.114837 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:23.115083 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.115062 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 21:09:23.115264 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.115245 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 21:09:23.115326 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.115280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.115326 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.115311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.115436 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.115342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-multus-cni-dir\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.115436 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.115367 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-run-k8s-cni-cncf-io\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.119943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-var-lib-cni-bin\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120002 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-system-cni-dir\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-os-release\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-os-release\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-hostroot\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120153 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq8vr\" (UniqueName: \"kubernetes.io/projected/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-kube-api-access-rq8vr\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120190 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-cnibin\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-var-lib-kubelet\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-cnibin\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-multus-conf-dir\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120374 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-multus-daemon-config\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/09063215-9ffa-4812-bdc0-7ac55baa2433-agent-certs\") pod \"konnectivity-agent-dr48r\" (UID: \"09063215-9ffa-4812-bdc0-7ac55baa2433\") " pod="kube-system/konnectivity-agent-dr48r" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-cni-binary-copy\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-multus-socket-dir-parent\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-cni-binary-copy\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.121383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-system-cni-dir\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.122609 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120582 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-var-lib-cni-multus\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.122609 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-run-multus-certs\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.122609 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/09063215-9ffa-4812-bdc0-7ac55baa2433-konnectivity-ca\") pod \"konnectivity-agent-dr48r\" (UID: \"09063215-9ffa-4812-bdc0-7ac55baa2433\") " pod="kube-system/konnectivity-agent-dr48r" Jul 13 21:09:23.122609 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhn4m\" (UniqueName: \"kubernetes.io/projected/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-kube-api-access-lhn4m\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.122609 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-run-netns\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.122609 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.120759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-etc-kubernetes\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.122609 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.122133 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.122974 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.122877 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 21:09:23.123302 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.123277 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 21:09:23.123382 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.123358 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z5wh6\"" Jul 13 21:09:23.123517 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.123502 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 21:09:23.123999 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.123978 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 21:09:23.124886 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.124854 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.125386 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.125368 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 21:09:23.126409 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.126386 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 21:09:23.126528 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.126393 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 21:09:23.126920 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.126868 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gqnh6\"" Jul 13 21:09:23.127115 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.127099 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 21:09:23.127451 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.127433 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 21:09:23.127532 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.127452 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 21:09:23.128018 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.128004 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vv2g9" Jul 13 21:09:23.128566 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.128547 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vvqn8\"" Jul 13 21:09:23.130293 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.130270 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 21:09:23.130657 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.130638 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 21:09:23.130760 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.130738 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tqlwk\"" Jul 13 21:09:23.130922 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.130870 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 21:09:23.131132 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.131110 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ndm6s" Jul 13 21:09:23.133440 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.133231 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 21:09:23.133440 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.133375 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:23.133583 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.133479 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:23.133815 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.133797 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p7v8n\"" Jul 13 21:09:23.134263 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.134247 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 21:09:23.135777 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.135754 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lnl7m" Jul 13 21:09:23.138252 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.138235 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 21:09:23.138822 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.138571 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5vgv9\"" Jul 13 21:09:23.138904 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.138882 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 21:09:23.138904 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.138891 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 21:09:23.141561 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.141536 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k9djc" Jul 13 21:09:23.149474 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.149117 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k9djc" Jul 13 21:09:23.204994 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.204851 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 21:09:23.221048 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-run-k8s-cni-cncf-io\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.221205 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-system-cni-dir\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.221205 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-os-release\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.221205 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:23.221205 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-run-ovn-kubernetes\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.221205 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221185 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-cni-bin\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.221472 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62f8f844-76a4-4822-8294-d846e3995e6e-tmp\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.221472 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221225 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-system-cni-dir\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.221472 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a29c809d-4076-4066-a33c-e804721344e9-iptables-alerter-script\") pod \"iptables-alerter-lnl7m\" (UID: \"a29c809d-4076-4066-a33c-e804721344e9\") " pod="openshift-network-operator/iptables-alerter-lnl7m" Jul 13 21:09:23.221472 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221259 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-var-lib-openvswitch\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.221472 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221283 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-run-k8s-cni-cncf-io\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.221472 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-hostroot\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.221472 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-etc-selinux\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.221472 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/69296318-76d8-464f-88cb-eca82b0cb0f7-hosts-file\") pod \"node-resolver-ndm6s\" (UID: \"69296318-76d8-464f-88cb-eca82b0cb0f7\") " pod="openshift-dns/node-resolver-ndm6s" Jul 13 21:09:23.221472 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-node-log\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.221472 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221391 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-os-release\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.221472 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221398 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-cni-netd\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.221472 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221324 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-hostroot\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.221472 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-var-lib-kubelet\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-sys-fs\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-systemd-units\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221620 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-var-lib-kubelet\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-run-systemd\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lccxb\" (UniqueName: \"kubernetes.io/projected/62f8f844-76a4-4822-8294-d846e3995e6e-kube-api-access-lccxb\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/989d6b5b-c88c-49a5-b4bb-16512682dddd-serviceca\") pod \"node-ca-vv2g9\" (UID: \"989d6b5b-c88c-49a5-b4bb-16512682dddd\") " pod="openshift-image-registry/node-ca-vv2g9" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221714 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxtp8\" (UniqueName: \"kubernetes.io/projected/989d6b5b-c88c-49a5-b4bb-16512682dddd-kube-api-access-hxtp8\") pod \"node-ca-vv2g9\" (UID: \"989d6b5b-c88c-49a5-b4bb-16512682dddd\") " pod="openshift-image-registry/node-ca-vv2g9" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-multus-daemon-config\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fmbl\" (UniqueName: \"kubernetes.io/projected/a29c809d-4076-4066-a33c-e804721344e9-kube-api-access-4fmbl\") pod \"iptables-alerter-lnl7m\" (UID: \"a29c809d-4076-4066-a33c-e804721344e9\") " pod="openshift-network-operator/iptables-alerter-lnl7m" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-run-openvswitch\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221857 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-log-socket\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44e3885c-dedd-4241-a1ac-863735f20219-ovnkube-config\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.222129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-var-lib-kubelet\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.221992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-host\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44e3885c-dedd-4241-a1ac-863735f20219-ovnkube-script-lib\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-systemd\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62f8f844-76a4-4822-8294-d846e3995e6e-etc-tuned\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r76sx\" (UniqueName: \"kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx\") pod \"network-check-target-82gqz\" (UID: \"2b98814f-5b72-4590-9aec-f15f1f82bdf9\") " pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn2zs\" (UniqueName: \"kubernetes.io/projected/69296318-76d8-464f-88cb-eca82b0cb0f7-kube-api-access-jn2zs\") pod \"node-resolver-ndm6s\" (UID: \"69296318-76d8-464f-88cb-eca82b0cb0f7\") " pod="openshift-dns/node-resolver-ndm6s" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-run-netns\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222172 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhn4m\" (UniqueName: \"kubernetes.io/projected/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-kube-api-access-lhn4m\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-run-netns\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-etc-kubernetes\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222328 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-registration-dir\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv4bv\" (UniqueName: \"kubernetes.io/projected/21fdbe6d-3840-4061-82a1-5267f5e94e25-kube-api-access-cv4bv\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69296318-76d8-464f-88cb-eca82b0cb0f7-tmp-dir\") pod \"node-resolver-ndm6s\" (UID: \"69296318-76d8-464f-88cb-eca82b0cb0f7\") " pod="openshift-dns/node-resolver-ndm6s" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44e3885c-dedd-4241-a1ac-863735f20219-ovn-node-metrics-cert\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.223016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222449 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljmts\" (UniqueName: \"kubernetes.io/projected/44e3885c-dedd-4241-a1ac-863735f20219-kube-api-access-ljmts\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222471 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-multus-daemon-config\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-multus-cni-dir\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-var-lib-cni-bin\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-device-dir\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-lib-modules\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-kubelet\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-os-release\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq8vr\" (UniqueName: \"kubernetes.io/projected/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-kube-api-access-rq8vr\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222795 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-cnibin\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222827 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-socket-dir\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44e3885c-dedd-4241-a1ac-863735f20219-env-overrides\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-slash\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-sysconfig\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/989d6b5b-c88c-49a5-b4bb-16512682dddd-host\") pod \"node-ca-vv2g9\" (UID: \"989d6b5b-c88c-49a5-b4bb-16512682dddd\") " pod="openshift-image-registry/node-ca-vv2g9" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.222969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-cnibin\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223020 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-multus-conf-dir\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.223816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223049 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-run-netns\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/09063215-9ffa-4812-bdc0-7ac55baa2433-agent-certs\") pod \"konnectivity-agent-dr48r\" (UID: \"09063215-9ffa-4812-bdc0-7ac55baa2433\") " pod="kube-system/konnectivity-agent-dr48r" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223094 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-dbus\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a29c809d-4076-4066-a33c-e804721344e9-host-slash\") pod \"iptables-alerter-lnl7m\" (UID: \"a29c809d-4076-4066-a33c-e804721344e9\") " pod="openshift-network-operator/iptables-alerter-lnl7m" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223167 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-sysctl-d\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223190 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-run\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-cni-binary-copy\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-multus-socket-dir-parent\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-sysctl-conf\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223305 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-cni-binary-copy\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223335 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-system-cni-dir\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-var-lib-cni-multus\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223362 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223391 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs\") pod \"network-metrics-daemon-lrpd6\" (UID: \"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180\") " pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvdxc\" (UniqueName: \"kubernetes.io/projected/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-kube-api-access-fvdxc\") pod \"network-metrics-daemon-lrpd6\" (UID: \"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180\") " pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-kubernetes\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-run-multus-certs\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.224637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/09063215-9ffa-4812-bdc0-7ac55baa2433-konnectivity-ca\") pod \"konnectivity-agent-dr48r\" (UID: \"09063215-9ffa-4812-bdc0-7ac55baa2433\") " pod="kube-system/konnectivity-agent-dr48r" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-kubelet-config\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-run-ovn\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-modprobe-d\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223710 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-sys\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-etc-openvswitch\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.223827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.224372 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-etc-kubernetes\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.224425 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-var-lib-cni-bin\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.224448 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.224493 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-os-release\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.224489 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-multus-cni-dir\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.224571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-cnibin\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.224598 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-multus-conf-dir\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.224599 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-cnibin\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.224635 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-run-multus-certs\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.225541 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.224633 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-multus-socket-dir-parent\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.226406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.224686 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-host-var-lib-cni-multus\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.226406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.224739 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-system-cni-dir\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.226406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.224963 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-cni-binary-copy\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.226406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.225228 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-cni-binary-copy\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.226406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.225272 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.226406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.225763 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/09063215-9ffa-4812-bdc0-7ac55baa2433-konnectivity-ca\") pod \"konnectivity-agent-dr48r\" (UID: \"09063215-9ffa-4812-bdc0-7ac55baa2433\") " pod="kube-system/konnectivity-agent-dr48r" Jul 13 21:09:23.228331 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.228288 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/09063215-9ffa-4812-bdc0-7ac55baa2433-agent-certs\") pod \"konnectivity-agent-dr48r\" (UID: \"09063215-9ffa-4812-bdc0-7ac55baa2433\") " pod="kube-system/konnectivity-agent-dr48r" Jul 13 21:09:23.233802 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.233773 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq8vr\" (UniqueName: \"kubernetes.io/projected/3d7a14a2-4edb-4728-8fe2-3a1838076a2d-kube-api-access-rq8vr\") pod \"multus-xkzpd\" (UID: \"3d7a14a2-4edb-4728-8fe2-3a1838076a2d\") " pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.235826 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.235800 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhn4m\" (UniqueName: \"kubernetes.io/projected/a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c-kube-api-access-lhn4m\") pod \"multus-additional-cni-plugins-b2ch8\" (UID: \"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c\") " pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.287550 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.287448 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-136.ec2.internal" event={"ID":"54563f63446557ad0a7d2b139842ad20","Type":"ContainerStarted","Data":"554a1e621b37e53a4b2d665cc7bc7be0af67b912df9f1c73a2902536463ff6d1"} Jul 13 21:09:23.289509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.289475 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal" event={"ID":"b035606ca1b52c27bd271db4a3fe92ae","Type":"ContainerStarted","Data":"d7a907e87aa65ed8a4b933c75d055962e6ba5dbccc4bd46451df5e19d16bb565"} Jul 13 21:09:23.324736 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.324699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-systemd-units\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.324736 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.324748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-run-systemd\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.325020 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.324774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lccxb\" (UniqueName: \"kubernetes.io/projected/62f8f844-76a4-4822-8294-d846e3995e6e-kube-api-access-lccxb\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.325020 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.324825 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-systemd-units\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.325020 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.324840 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-run-systemd\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.325020 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.324897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/989d6b5b-c88c-49a5-b4bb-16512682dddd-serviceca\") pod \"node-ca-vv2g9\" (UID: \"989d6b5b-c88c-49a5-b4bb-16512682dddd\") " pod="openshift-image-registry/node-ca-vv2g9" Jul 13 21:09:23.325020 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.324929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxtp8\" (UniqueName: \"kubernetes.io/projected/989d6b5b-c88c-49a5-b4bb-16512682dddd-kube-api-access-hxtp8\") pod \"node-ca-vv2g9\" (UID: \"989d6b5b-c88c-49a5-b4bb-16512682dddd\") " pod="openshift-image-registry/node-ca-vv2g9" Jul 13 21:09:23.325020 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.324954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fmbl\" (UniqueName: \"kubernetes.io/projected/a29c809d-4076-4066-a33c-e804721344e9-kube-api-access-4fmbl\") pod \"iptables-alerter-lnl7m\" (UID: \"a29c809d-4076-4066-a33c-e804721344e9\") " pod="openshift-network-operator/iptables-alerter-lnl7m" Jul 13 21:09:23.325020 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.324978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-run-openvswitch\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.325020 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-log-socket\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325098 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-run-openvswitch\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325142 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-log-socket\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44e3885c-dedd-4241-a1ac-863735f20219-ovnkube-config\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325197 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-var-lib-kubelet\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325221 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-host\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325241 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44e3885c-dedd-4241-a1ac-863735f20219-ovnkube-script-lib\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-systemd\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62f8f844-76a4-4822-8294-d846e3995e6e-etc-tuned\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76sx\" (UniqueName: \"kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx\") pod \"network-check-target-82gqz\" (UID: \"2b98814f-5b72-4590-9aec-f15f1f82bdf9\") " pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn2zs\" (UniqueName: \"kubernetes.io/projected/69296318-76d8-464f-88cb-eca82b0cb0f7-kube-api-access-jn2zs\") pod \"node-resolver-ndm6s\" (UID: \"69296318-76d8-464f-88cb-eca82b0cb0f7\") " pod="openshift-dns/node-resolver-ndm6s" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-run-netns\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325425 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/989d6b5b-c88c-49a5-b4bb-16512682dddd-serviceca\") pod \"node-ca-vv2g9\" (UID: \"989d6b5b-c88c-49a5-b4bb-16512682dddd\") " pod="openshift-image-registry/node-ca-vv2g9" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.325454 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-registration-dir\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325524 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-registration-dir\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325574 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-systemd\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325873 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44e3885c-dedd-4241-a1ac-863735f20219-ovnkube-script-lib\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325875 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44e3885c-dedd-4241-a1ac-863735f20219-ovnkube-config\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv4bv\" (UniqueName: \"kubernetes.io/projected/21fdbe6d-3840-4061-82a1-5267f5e94e25-kube-api-access-cv4bv\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69296318-76d8-464f-88cb-eca82b0cb0f7-tmp-dir\") pod \"node-resolver-ndm6s\" (UID: \"69296318-76d8-464f-88cb-eca82b0cb0f7\") " pod="openshift-dns/node-resolver-ndm6s" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325988 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-var-lib-kubelet\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.325991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44e3885c-dedd-4241-a1ac-863735f20219-ovn-node-metrics-cert\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljmts\" (UniqueName: \"kubernetes.io/projected/44e3885c-dedd-4241-a1ac-863735f20219-kube-api-access-ljmts\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-device-dir\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326118 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-lib-modules\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-kubelet\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-socket-dir\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44e3885c-dedd-4241-a1ac-863735f20219-env-overrides\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-slash\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-sysconfig\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.326408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/989d6b5b-c88c-49a5-b4bb-16512682dddd-host\") pod \"node-ca-vv2g9\" (UID: \"989d6b5b-c88c-49a5-b4bb-16512682dddd\") " pod="openshift-image-registry/node-ca-vv2g9" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-dbus\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326336 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a29c809d-4076-4066-a33c-e804721344e9-host-slash\") pod \"iptables-alerter-lnl7m\" (UID: \"a29c809d-4076-4066-a33c-e804721344e9\") " pod="openshift-network-operator/iptables-alerter-lnl7m" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-sysctl-d\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326385 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-run\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-sysctl-conf\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326458 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-host\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs\") pod \"network-metrics-daemon-lrpd6\" (UID: \"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180\") " pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvdxc\" (UniqueName: \"kubernetes.io/projected/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-kube-api-access-fvdxc\") pod \"network-metrics-daemon-lrpd6\" (UID: \"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180\") " pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326507 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-run-netns\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-kubernetes\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-kubelet-config\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-run-ovn\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326601 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-sysconfig\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326610 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-modprobe-d\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326650 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/989d6b5b-c88c-49a5-b4bb-16512682dddd-host\") pod \"node-ca-vv2g9\" (UID: \"989d6b5b-c88c-49a5-b4bb-16512682dddd\") " pod="openshift-image-registry/node-ca-vv2g9" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326666 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a29c809d-4076-4066-a33c-e804721344e9-host-slash\") pod \"iptables-alerter-lnl7m\" (UID: \"a29c809d-4076-4066-a33c-e804721344e9\") " pod="openshift-network-operator/iptables-alerter-lnl7m" Jul 13 21:09:23.327297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-sys\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-etc-openvswitch\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-run-ovn-kubernetes\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326812 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-sysctl-d\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326865 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-sys\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326872 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-run\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326811 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44e3885c-dedd-4241-a1ac-863735f20219-env-overrides\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326961 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-kubelet-config\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326556 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-slash\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327019 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-run-ovn\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327033 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-sysctl-conf\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327077 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-device-dir\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327107 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-modprobe-d\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.326813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-cni-bin\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62f8f844-76a4-4822-8294-d846e3995e6e-tmp\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a29c809d-4076-4066-a33c-e804721344e9-iptables-alerter-script\") pod \"iptables-alerter-lnl7m\" (UID: \"a29c809d-4076-4066-a33c-e804721344e9\") " pod="openshift-network-operator/iptables-alerter-lnl7m" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327198 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-lib-modules\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.328290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-var-lib-openvswitch\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-etc-selinux\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327242 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-kubelet\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/69296318-76d8-464f-88cb-eca82b0cb0f7-hosts-file\") pod \"node-resolver-ndm6s\" (UID: \"69296318-76d8-464f-88cb-eca82b0cb0f7\") " pod="openshift-dns/node-resolver-ndm6s" Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327272 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-run-ovn-kubernetes\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-node-log\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-cni-netd\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327312 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-cni-bin\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-sys-fs\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327347 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-socket-dir\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327405 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-dbus\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.327496 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.327556 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs podName:08ad96d7-5c9a-4f9a-a5ad-64d3949f5180 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:23.827535675 +0000 UTC m=+3.160200120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs") pod "network-metrics-daemon-lrpd6" (UID: "08ad96d7-5c9a-4f9a-a5ad-64d3949f5180") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327603 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62f8f844-76a4-4822-8294-d846e3995e6e-etc-kubernetes\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327618 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69296318-76d8-464f-88cb-eca82b0cb0f7-tmp-dir\") pod \"node-resolver-ndm6s\" (UID: \"69296318-76d8-464f-88cb-eca82b0cb0f7\") " pod="openshift-dns/node-resolver-ndm6s" Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.327707 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327749 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-var-lib-openvswitch\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.329220 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.327774 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret podName:1426ed32-f4b7-404b-bfaf-6b7df8984ec6 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:23.827754515 +0000 UTC m=+3.160418950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret") pod "global-pull-secret-syncer-5t86b" (UID: "1426ed32-f4b7-404b-bfaf-6b7df8984ec6") : object "kube-system"/"original-pull-secret" not registered Jul 13 21:09:23.330178 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327816 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-node-log\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.330178 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327817 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-etc-openvswitch\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.330178 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327846 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44e3885c-dedd-4241-a1ac-863735f20219-host-cni-netd\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.330178 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327883 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-sys-fs\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.330178 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.327972 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/69296318-76d8-464f-88cb-eca82b0cb0f7-hosts-file\") pod \"node-resolver-ndm6s\" (UID: \"69296318-76d8-464f-88cb-eca82b0cb0f7\") " pod="openshift-dns/node-resolver-ndm6s" Jul 13 21:09:23.330178 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.328006 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21fdbe6d-3840-4061-82a1-5267f5e94e25-etc-selinux\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.330178 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.328316 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a29c809d-4076-4066-a33c-e804721344e9-iptables-alerter-script\") pod \"iptables-alerter-lnl7m\" (UID: \"a29c809d-4076-4066-a33c-e804721344e9\") " pod="openshift-network-operator/iptables-alerter-lnl7m" Jul 13 21:09:23.330178 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.328429 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62f8f844-76a4-4822-8294-d846e3995e6e-etc-tuned\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.330178 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.329510 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44e3885c-dedd-4241-a1ac-863735f20219-ovn-node-metrics-cert\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.330749 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.330718 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62f8f844-76a4-4822-8294-d846e3995e6e-tmp\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.343676 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.343228 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 21:09:23.343676 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.343263 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 21:09:23.343676 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.343299 2576 projected.go:196] Error preparing data for projected volume kube-api-access-r76sx for pod openshift-network-diagnostics/network-check-target-82gqz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:09:23.343676 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.343454 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx podName:2b98814f-5b72-4590-9aec-f15f1f82bdf9 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:23.843432077 +0000 UTC m=+3.176096516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r76sx" (UniqueName: "kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx") pod "network-check-target-82gqz" (UID: "2b98814f-5b72-4590-9aec-f15f1f82bdf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:09:23.344665 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.344610 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvdxc\" (UniqueName: \"kubernetes.io/projected/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-kube-api-access-fvdxc\") pod \"network-metrics-daemon-lrpd6\" (UID: \"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180\") " pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:23.346171 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.346143 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn2zs\" (UniqueName: \"kubernetes.io/projected/69296318-76d8-464f-88cb-eca82b0cb0f7-kube-api-access-jn2zs\") pod \"node-resolver-ndm6s\" (UID: \"69296318-76d8-464f-88cb-eca82b0cb0f7\") " pod="openshift-dns/node-resolver-ndm6s" Jul 13 21:09:23.346394 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.346359 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv4bv\" (UniqueName: \"kubernetes.io/projected/21fdbe6d-3840-4061-82a1-5267f5e94e25-kube-api-access-cv4bv\") pod \"aws-ebs-csi-driver-node-hpkr6\" (UID: \"21fdbe6d-3840-4061-82a1-5267f5e94e25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.346494 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.346403 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lccxb\" (UniqueName: \"kubernetes.io/projected/62f8f844-76a4-4822-8294-d846e3995e6e-kube-api-access-lccxb\") pod \"tuned-6jbbx\" (UID: \"62f8f844-76a4-4822-8294-d846e3995e6e\") " pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.347065 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.347027 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxtp8\" (UniqueName: \"kubernetes.io/projected/989d6b5b-c88c-49a5-b4bb-16512682dddd-kube-api-access-hxtp8\") pod \"node-ca-vv2g9\" (UID: \"989d6b5b-c88c-49a5-b4bb-16512682dddd\") " pod="openshift-image-registry/node-ca-vv2g9" Jul 13 21:09:23.347892 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.347864 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljmts\" (UniqueName: \"kubernetes.io/projected/44e3885c-dedd-4241-a1ac-863735f20219-kube-api-access-ljmts\") pod \"ovnkube-node-dgjsx\" (UID: \"44e3885c-dedd-4241-a1ac-863735f20219\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.348234 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.348212 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fmbl\" (UniqueName: \"kubernetes.io/projected/a29c809d-4076-4066-a33c-e804721344e9-kube-api-access-4fmbl\") pod \"iptables-alerter-lnl7m\" (UID: \"a29c809d-4076-4066-a33c-e804721344e9\") " pod="openshift-network-operator/iptables-alerter-lnl7m" Jul 13 21:09:23.415537 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.415494 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xkzpd" Jul 13 21:09:23.422790 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.422764 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dr48r" Jul 13 21:09:23.437836 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.437811 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b2ch8" Jul 13 21:09:23.445026 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.444995 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:23.455298 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.455276 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" Jul 13 21:09:23.464178 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.464157 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" Jul 13 21:09:23.473243 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.473185 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vv2g9" Jul 13 21:09:23.482163 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.482144 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ndm6s" Jul 13 21:09:23.491023 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.490991 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lnl7m" Jul 13 21:09:23.831362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.831257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs\") pod \"network-metrics-daemon-lrpd6\" (UID: \"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180\") " pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:23.831362 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.831311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:23.831593 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.831483 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 21:09:23.834230 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.832013 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:09:23.834230 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.832073 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret podName:1426ed32-f4b7-404b-bfaf-6b7df8984ec6 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:24.83202457 +0000 UTC m=+4.164689006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret") pod "global-pull-secret-syncer-5t86b" (UID: "1426ed32-f4b7-404b-bfaf-6b7df8984ec6") : object "kube-system"/"original-pull-secret" not registered Jul 13 21:09:23.834230 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.832131 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs podName:08ad96d7-5c9a-4f9a-a5ad-64d3949f5180 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:24.832102523 +0000 UTC m=+4.164766959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs") pod "network-metrics-daemon-lrpd6" (UID: "08ad96d7-5c9a-4f9a-a5ad-64d3949f5180") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:09:23.932339 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:23.932289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76sx\" (UniqueName: \"kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx\") pod \"network-check-target-82gqz\" (UID: \"2b98814f-5b72-4590-9aec-f15f1f82bdf9\") " pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:23.932541 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.932483 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 21:09:23.932541 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.932505 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 21:09:23.932541 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.932518 2576 projected.go:196] Error preparing data for projected volume kube-api-access-r76sx for pod openshift-network-diagnostics/network-check-target-82gqz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:09:23.932724 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:23.932592 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx podName:2b98814f-5b72-4590-9aec-f15f1f82bdf9 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:24.932577491 +0000 UTC m=+4.265241929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r76sx" (UniqueName: "kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx") pod "network-check-target-82gqz" (UID: "2b98814f-5b72-4590-9aec-f15f1f82bdf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:09:24.152801 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:24.152665 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 21:04:23 +0000 UTC" deadline="2027-12-21 03:23:40.338520607 +0000 UTC" Jul 13 21:09:24.152801 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:24.152739 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12606h14m16.185786256s" Jul 13 21:09:24.274176 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:24.274144 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:24.274603 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:24.274276 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:24.415991 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:24.415957 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7a14a2_4edb_4728_8fe2_3a1838076a2d.slice/crio-0d9c694548bd0924e6c2e1f96d322fabb989bfc6f93c6727075b8a0db4b20534 WatchSource:0}: Error finding container 0d9c694548bd0924e6c2e1f96d322fabb989bfc6f93c6727075b8a0db4b20534: Status 404 returned error can't find the container with id 0d9c694548bd0924e6c2e1f96d322fabb989bfc6f93c6727075b8a0db4b20534 Jul 13 21:09:24.438448 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:24.438420 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21fdbe6d_3840_4061_82a1_5267f5e94e25.slice/crio-3e94e3a9319099ece811bd89e16dc2f4acfe33220ba92e2ecaef52603a4a9309 WatchSource:0}: Error finding container 3e94e3a9319099ece811bd89e16dc2f4acfe33220ba92e2ecaef52603a4a9309: Status 404 returned error can't find the container with id 3e94e3a9319099ece811bd89e16dc2f4acfe33220ba92e2ecaef52603a4a9309 Jul 13 21:09:24.440547 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:24.440525 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29c809d_4076_4066_a33c_e804721344e9.slice/crio-7e259d6101496f7aba3803ba8c4455b4c637907079273de169d2f53a17d999b7 WatchSource:0}: Error finding container 7e259d6101496f7aba3803ba8c4455b4c637907079273de169d2f53a17d999b7: Status 404 returned error can't find the container with id 7e259d6101496f7aba3803ba8c4455b4c637907079273de169d2f53a17d999b7 Jul 13 21:09:24.441450 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:24.441425 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f8f844_76a4_4822_8294_d846e3995e6e.slice/crio-b08c5920e97a201faff37d6a150b47a41a732e7aad99ea7a3418a8b9c3680697 WatchSource:0}: Error finding container b08c5920e97a201faff37d6a150b47a41a732e7aad99ea7a3418a8b9c3680697: Status 404 returned error can't find the container with id b08c5920e97a201faff37d6a150b47a41a732e7aad99ea7a3418a8b9c3680697 Jul 13 21:09:24.445995 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:24.445968 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod989d6b5b_c88c_49a5_b4bb_16512682dddd.slice/crio-036507ee986047b799bc1a02871a7f99e6c04ef30cca1ee1b034e319723079a9 WatchSource:0}: Error finding container 036507ee986047b799bc1a02871a7f99e6c04ef30cca1ee1b034e319723079a9: Status 404 returned error can't find the container with id 036507ee986047b799bc1a02871a7f99e6c04ef30cca1ee1b034e319723079a9 Jul 13 21:09:24.446828 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:24.446799 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e3885c_dedd_4241_a1ac_863735f20219.slice/crio-d1d193d64cde86b8728ef9be8d9f83d838396101a30b70e26543e66b4c8eb44b WatchSource:0}: Error finding container d1d193d64cde86b8728ef9be8d9f83d838396101a30b70e26543e66b4c8eb44b: Status 404 returned error can't find the container with id d1d193d64cde86b8728ef9be8d9f83d838396101a30b70e26543e66b4c8eb44b Jul 13 21:09:24.448021 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:24.447897 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ec0e5a_ca03_4aba_bc16_9a1f49a1180c.slice/crio-a9b95d023248ac4d441de495a7395de88e2b6528eac3c5c883a34411c7a35eed WatchSource:0}: Error finding container a9b95d023248ac4d441de495a7395de88e2b6528eac3c5c883a34411c7a35eed: Status 404 returned error can't find the container with id a9b95d023248ac4d441de495a7395de88e2b6528eac3c5c883a34411c7a35eed Jul 13 21:09:24.449510 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:24.449445 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09063215_9ffa_4812_bdc0_7ac55baa2433.slice/crio-a1d2967d486b5317d4ae3446a50aa984495e8215c9c22947c19b7bcc1305ead4 WatchSource:0}: Error finding container a1d2967d486b5317d4ae3446a50aa984495e8215c9c22947c19b7bcc1305ead4: Status 404 returned error can't find the container with id a1d2967d486b5317d4ae3446a50aa984495e8215c9c22947c19b7bcc1305ead4 Jul 13 21:09:24.782383 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:24.782197 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 21:09:24.840279 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:24.840246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs\") pod \"network-metrics-daemon-lrpd6\" (UID: \"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180\") " pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:24.840460 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:24.840289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:24.840539 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:24.840488 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:09:24.840539 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:24.840502 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 21:09:24.840615 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:24.840571 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret podName:1426ed32-f4b7-404b-bfaf-6b7df8984ec6 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:26.840548557 +0000 UTC m=+6.173212993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret") pod "global-pull-secret-syncer-5t86b" (UID: "1426ed32-f4b7-404b-bfaf-6b7df8984ec6") : object "kube-system"/"original-pull-secret" not registered Jul 13 21:09:24.840615 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:24.840592 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs podName:08ad96d7-5c9a-4f9a-a5ad-64d3949f5180 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:26.840580373 +0000 UTC m=+6.173244798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs") pod "network-metrics-daemon-lrpd6" (UID: "08ad96d7-5c9a-4f9a-a5ad-64d3949f5180") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:09:24.941483 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:24.941407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76sx\" (UniqueName: \"kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx\") pod \"network-check-target-82gqz\" (UID: \"2b98814f-5b72-4590-9aec-f15f1f82bdf9\") " pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:24.941662 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:24.941571 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 21:09:24.941662 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:24.941595 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 21:09:24.941662 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:24.941609 2576 projected.go:196] Error preparing data for projected volume kube-api-access-r76sx for pod openshift-network-diagnostics/network-check-target-82gqz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:09:24.941848 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:24.941675 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx podName:2b98814f-5b72-4590-9aec-f15f1f82bdf9 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:26.941656371 +0000 UTC m=+6.274320806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r76sx" (UniqueName: "kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx") pod "network-check-target-82gqz" (UID: "2b98814f-5b72-4590-9aec-f15f1f82bdf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:09:25.153569 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.153517 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 21:04:23 +0000 UTC" deadline="2028-02-16 14:24:29.234830072 +0000 UTC" Jul 13 21:09:25.153569 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.153565 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13985h15m4.08126996s" Jul 13 21:09:25.281018 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.280795 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:25.282209 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:25.281601 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:25.282209 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.282043 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:25.282209 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:25.282144 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:25.314194 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.313952 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-136.ec2.internal" event={"ID":"54563f63446557ad0a7d2b139842ad20","Type":"ContainerStarted","Data":"130eb8c8de4dd1097236bfe018e73b7e16492f5af6bd9cb79c137f27ae4a6865"} Jul 13 21:09:25.334883 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.334844 2576 generic.go:356] "Generic (PLEG): container finished" podID="b035606ca1b52c27bd271db4a3fe92ae" containerID="b28888ec4c517f2af9aba1ea30e671f4c3d9adedc56b4e150c56ad5fd38a69ff" exitCode=0 Jul 13 21:09:25.335178 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.335154 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal" event={"ID":"b035606ca1b52c27bd271db4a3fe92ae","Type":"ContainerDied","Data":"b28888ec4c517f2af9aba1ea30e671f4c3d9adedc56b4e150c56ad5fd38a69ff"} Jul 13 21:09:25.344339 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.344307 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2ch8" event={"ID":"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c","Type":"ContainerStarted","Data":"a9b95d023248ac4d441de495a7395de88e2b6528eac3c5c883a34411c7a35eed"} Jul 13 21:09:25.351698 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.351240 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-136.ec2.internal" podStartSLOduration=2.351220032 podStartE2EDuration="2.351220032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:25.330172509 +0000 UTC m=+4.662836970" watchObservedRunningTime="2026-07-13 21:09:25.351220032 +0000 UTC m=+4.683884471" Jul 13 21:09:25.363567 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.363540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" event={"ID":"62f8f844-76a4-4822-8294-d846e3995e6e","Type":"ContainerStarted","Data":"b08c5920e97a201faff37d6a150b47a41a732e7aad99ea7a3418a8b9c3680697"} Jul 13 21:09:25.377356 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.377257 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" event={"ID":"21fdbe6d-3840-4061-82a1-5267f5e94e25","Type":"ContainerStarted","Data":"3e94e3a9319099ece811bd89e16dc2f4acfe33220ba92e2ecaef52603a4a9309"} Jul 13 21:09:25.410382 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.410339 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xkzpd" event={"ID":"3d7a14a2-4edb-4728-8fe2-3a1838076a2d","Type":"ContainerStarted","Data":"0d9c694548bd0924e6c2e1f96d322fabb989bfc6f93c6727075b8a0db4b20534"} Jul 13 21:09:25.446313 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.446267 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ndm6s" event={"ID":"69296318-76d8-464f-88cb-eca82b0cb0f7","Type":"ContainerStarted","Data":"817a2b8041c8ece38264d8a1b55d743be59ac248fd4b74e917ad864a1bdadf03"} Jul 13 21:09:25.450051 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.449961 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dr48r" event={"ID":"09063215-9ffa-4812-bdc0-7ac55baa2433","Type":"ContainerStarted","Data":"a1d2967d486b5317d4ae3446a50aa984495e8215c9c22947c19b7bcc1305ead4"} Jul 13 21:09:25.462737 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.462699 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" event={"ID":"44e3885c-dedd-4241-a1ac-863735f20219","Type":"ContainerStarted","Data":"d1d193d64cde86b8728ef9be8d9f83d838396101a30b70e26543e66b4c8eb44b"} Jul 13 21:09:25.468215 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.468179 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vv2g9" event={"ID":"989d6b5b-c88c-49a5-b4bb-16512682dddd","Type":"ContainerStarted","Data":"036507ee986047b799bc1a02871a7f99e6c04ef30cca1ee1b034e319723079a9"} Jul 13 21:09:25.474122 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:25.474089 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lnl7m" event={"ID":"a29c809d-4076-4066-a33c-e804721344e9","Type":"ContainerStarted","Data":"7e259d6101496f7aba3803ba8c4455b4c637907079273de169d2f53a17d999b7"} Jul 13 21:09:26.273808 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:26.273767 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:26.274040 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:26.273952 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:26.492062 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:26.491997 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal" event={"ID":"b035606ca1b52c27bd271db4a3fe92ae","Type":"ContainerStarted","Data":"a252e6d255b53bd65e9b6f71eb1dd93ffc0f7aa1192530ef1c5e5177d52be5eb"} Jul 13 21:09:26.509447 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:26.509087 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-136.ec2.internal" podStartSLOduration=3.509064429 podStartE2EDuration="3.509064429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:26.508062587 +0000 UTC m=+5.840727037" watchObservedRunningTime="2026-07-13 21:09:26.509064429 +0000 UTC m=+5.841728874" Jul 13 21:09:26.857529 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:26.857488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs\") pod \"network-metrics-daemon-lrpd6\" (UID: \"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180\") " pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:26.857724 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:26.857556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:26.857787 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:26.857752 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 21:09:26.857838 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:26.857818 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret podName:1426ed32-f4b7-404b-bfaf-6b7df8984ec6 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:30.857798879 +0000 UTC m=+10.190463315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret") pod "global-pull-secret-syncer-5t86b" (UID: "1426ed32-f4b7-404b-bfaf-6b7df8984ec6") : object "kube-system"/"original-pull-secret" not registered Jul 13 21:09:26.858292 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:26.858271 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:09:26.858393 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:26.858341 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs podName:08ad96d7-5c9a-4f9a-a5ad-64d3949f5180 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:30.858324233 +0000 UTC m=+10.190988658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs") pod "network-metrics-daemon-lrpd6" (UID: "08ad96d7-5c9a-4f9a-a5ad-64d3949f5180") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:09:26.958547 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:26.958506 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76sx\" (UniqueName: \"kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx\") pod \"network-check-target-82gqz\" (UID: \"2b98814f-5b72-4590-9aec-f15f1f82bdf9\") " pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:26.958755 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:26.958732 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 21:09:26.958824 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:26.958765 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 21:09:26.958824 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:26.958780 2576 projected.go:196] Error preparing data for projected volume kube-api-access-r76sx for pod openshift-network-diagnostics/network-check-target-82gqz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:09:26.958954 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:26.958854 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx podName:2b98814f-5b72-4590-9aec-f15f1f82bdf9 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:30.958834971 +0000 UTC m=+10.291499410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r76sx" (UniqueName: "kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx") pod "network-check-target-82gqz" (UID: "2b98814f-5b72-4590-9aec-f15f1f82bdf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:09:27.276720 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:27.276687 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:27.276933 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:27.276821 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:27.277248 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:27.277226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:27.277361 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:27.277341 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:28.273858 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:28.273820 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:28.274366 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:28.273996 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:29.274436 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:29.274359 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:29.274933 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:29.274510 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:29.274933 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:29.274877 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:29.275077 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:29.275024 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:30.274628 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:30.274582 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:30.275238 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:30.274751 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:30.897516 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:30.897468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs\") pod \"network-metrics-daemon-lrpd6\" (UID: \"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180\") " pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:30.897694 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:30.897536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:30.897694 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:30.897659 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 21:09:30.897694 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:30.897671 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:09:30.897878 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:30.897730 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret podName:1426ed32-f4b7-404b-bfaf-6b7df8984ec6 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:38.897709607 +0000 UTC m=+18.230374043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret") pod "global-pull-secret-syncer-5t86b" (UID: "1426ed32-f4b7-404b-bfaf-6b7df8984ec6") : object "kube-system"/"original-pull-secret" not registered Jul 13 21:09:30.897878 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:30.897752 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs podName:08ad96d7-5c9a-4f9a-a5ad-64d3949f5180 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:38.89774064 +0000 UTC m=+18.230405061 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs") pod "network-metrics-daemon-lrpd6" (UID: "08ad96d7-5c9a-4f9a-a5ad-64d3949f5180") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:09:30.999164 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:30.998470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76sx\" (UniqueName: \"kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx\") pod \"network-check-target-82gqz\" (UID: \"2b98814f-5b72-4590-9aec-f15f1f82bdf9\") " pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:30.999164 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:30.998643 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 21:09:30.999164 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:30.998664 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 21:09:30.999164 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:30.998677 2576 projected.go:196] Error preparing data for projected volume kube-api-access-r76sx for pod openshift-network-diagnostics/network-check-target-82gqz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:09:30.999164 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:30.998741 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx podName:2b98814f-5b72-4590-9aec-f15f1f82bdf9 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:38.998722006 +0000 UTC m=+18.331386433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r76sx" (UniqueName: "kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx") pod "network-check-target-82gqz" (UID: "2b98814f-5b72-4590-9aec-f15f1f82bdf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:09:31.275294 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:31.274601 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:31.275294 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:31.274723 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:31.275294 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:31.275143 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:31.275294 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:31.275242 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:32.274547 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:32.274060 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:32.274547 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:32.274205 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:33.274116 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:33.273976 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:33.274609 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:33.274139 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:33.274672 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:33.274629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:33.274749 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:33.274723 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:34.274305 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:34.274270 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:34.274788 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:34.274418 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:35.274463 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:35.274422 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:35.274463 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:35.274458 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:35.274913 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:35.274594 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:35.274913 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:35.274719 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:36.274139 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:36.274105 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:36.274296 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:36.274243 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:37.273843 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:37.273774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:37.274333 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:37.273914 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:37.274333 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:37.273973 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:37.274333 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:37.274087 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:38.274465 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:38.274433 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:38.275005 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:38.274583 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:38.963624 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:38.963581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:38.963805 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:38.963678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs\") pod \"network-metrics-daemon-lrpd6\" (UID: \"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180\") " pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:38.963805 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:38.963765 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 21:09:38.963945 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:38.963850 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:09:38.963945 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:38.963872 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret podName:1426ed32-f4b7-404b-bfaf-6b7df8984ec6 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:54.963833751 +0000 UTC m=+34.296498176 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret") pod "global-pull-secret-syncer-5t86b" (UID: "1426ed32-f4b7-404b-bfaf-6b7df8984ec6") : object "kube-system"/"original-pull-secret" not registered Jul 13 21:09:38.963945 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:38.963913 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs podName:08ad96d7-5c9a-4f9a-a5ad-64d3949f5180 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:54.963895366 +0000 UTC m=+34.296559795 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs") pod "network-metrics-daemon-lrpd6" (UID: "08ad96d7-5c9a-4f9a-a5ad-64d3949f5180") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:09:39.064166 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:39.064125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76sx\" (UniqueName: \"kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx\") pod \"network-check-target-82gqz\" (UID: \"2b98814f-5b72-4590-9aec-f15f1f82bdf9\") " pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:39.064346 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:39.064295 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 21:09:39.064346 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:39.064323 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 21:09:39.064346 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:39.064337 2576 projected.go:196] Error preparing data for projected volume kube-api-access-r76sx for pod openshift-network-diagnostics/network-check-target-82gqz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:09:39.064511 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:39.064406 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx podName:2b98814f-5b72-4590-9aec-f15f1f82bdf9 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:55.06438958 +0000 UTC m=+34.397054006 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r76sx" (UniqueName: "kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx") pod "network-check-target-82gqz" (UID: "2b98814f-5b72-4590-9aec-f15f1f82bdf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:09:39.274723 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:39.274639 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:39.275145 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:39.274777 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:39.275145 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:39.274834 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:39.275145 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:39.274983 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:40.274609 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:40.274577 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:40.274808 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:40.274714 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:41.275355 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:41.275311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:41.275823 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:41.275420 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:41.275823 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:41.275731 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:41.275947 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:41.275821 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:42.274639 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:42.274606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:42.274807 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:42.274727 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:43.273924 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:43.273893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:43.273924 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:43.273919 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:43.274527 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:43.274030 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:43.274527 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:43.274119 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:44.274679 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.274355 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:44.275482 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:44.274776 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:44.534480 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.534432 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" event={"ID":"44e3885c-dedd-4241-a1ac-863735f20219","Type":"ContainerStarted","Data":"1279e96fae5cebaeb7121c8a02e5ffed4f4ae2e4afb52a24266c3af62f93054c"} Jul 13 21:09:44.534646 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.534527 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" event={"ID":"44e3885c-dedd-4241-a1ac-863735f20219","Type":"ContainerStarted","Data":"6d7832d2657f8c9de6b8f4c3a119a5ecb12067ae0878e8886a8fb86e3988f376"} Jul 13 21:09:44.534646 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.534617 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" event={"ID":"44e3885c-dedd-4241-a1ac-863735f20219","Type":"ContainerStarted","Data":"a26ffd1f40a6a081d6b7883b12e483101323018e2adefc564827ca4e923efdfc"} Jul 13 21:09:44.534763 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.534667 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" event={"ID":"44e3885c-dedd-4241-a1ac-863735f20219","Type":"ContainerStarted","Data":"8cc982f11e71b70ff686e5c7c345bd514453e25a4997032266e17ca6627733f5"} Jul 13 21:09:44.534763 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.534734 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" event={"ID":"44e3885c-dedd-4241-a1ac-863735f20219","Type":"ContainerStarted","Data":"d0d425d0afa81f556c8a8d7303810b48d88f4f54aaee6ac7cef7fd0c3e9546f5"} Jul 13 21:09:44.534873 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.534769 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" event={"ID":"44e3885c-dedd-4241-a1ac-863735f20219","Type":"ContainerStarted","Data":"38dd2ee450f00d077365e3dcd1dedf75b7e78a8b30653877aed3990ab60c6f89"} Jul 13 21:09:44.536318 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.536292 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vv2g9" event={"ID":"989d6b5b-c88c-49a5-b4bb-16512682dddd","Type":"ContainerStarted","Data":"30573f5f826fe917ca5d104985b2d1eb69a15e2be5b3f7b65c2b25dc231eb8b1"} Jul 13 21:09:44.541487 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.541457 2576 generic.go:356] "Generic (PLEG): container finished" podID="a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c" containerID="e59c6c4849612c799b0ddb21eb46824bded5066347c054ed4c2e8ad02dff2283" exitCode=0 Jul 13 21:09:44.541622 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.541542 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2ch8" event={"ID":"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c","Type":"ContainerDied","Data":"e59c6c4849612c799b0ddb21eb46824bded5066347c054ed4c2e8ad02dff2283"} Jul 13 21:09:44.543623 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.543601 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" event={"ID":"62f8f844-76a4-4822-8294-d846e3995e6e","Type":"ContainerStarted","Data":"7350c2d645f5fcdb64cfdce180d31ac84b23308f8964e1c61e786babbe3fe039"} Jul 13 21:09:44.545206 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.545151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" event={"ID":"21fdbe6d-3840-4061-82a1-5267f5e94e25","Type":"ContainerStarted","Data":"24672ec5c142f2a59f07076fc691c644ca6d0b6513f269e925358b8db2b6b33f"} Jul 13 21:09:44.548547 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.548524 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xkzpd" event={"ID":"3d7a14a2-4edb-4728-8fe2-3a1838076a2d","Type":"ContainerStarted","Data":"39a430d43fd91eaf1bcb533dee755a79923258a0f22af666fb30189b9c9e8d9c"} Jul 13 21:09:44.549845 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.549825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ndm6s" event={"ID":"69296318-76d8-464f-88cb-eca82b0cb0f7","Type":"ContainerStarted","Data":"fb7491e441c3f365cd159e64b6cda13a1dc83ae6e782189850fef886b61b66de"} Jul 13 21:09:44.551092 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.551072 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dr48r" event={"ID":"09063215-9ffa-4812-bdc0-7ac55baa2433","Type":"ContainerStarted","Data":"6832079dec099cd09e1b46f1a372ace47806a63ab7c4b0bcc3febdf264c3f7a6"} Jul 13 21:09:44.552618 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.552581 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vv2g9" podStartSLOduration=7.349991122 podStartE2EDuration="22.552567716s" totalImagesPullingTime="15.202576594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:44.552134715 +0000 UTC m=+23.884799168" watchObservedRunningTime="2026-07-13 21:09:44.552567716 +0000 UTC m=+23.885232157" Jul 13 21:09:44.568249 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.568205 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xkzpd" podStartSLOduration=3.120030415 podStartE2EDuration="22.568193365s" totalImagesPullingTime="19.44816295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:44.567540216 +0000 UTC m=+23.900204659" watchObservedRunningTime="2026-07-13 21:09:44.568193365 +0000 UTC m=+23.900857806" Jul 13 21:09:44.602569 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.602463 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ndm6s" podStartSLOduration=3.251307515 podStartE2EDuration="22.602447961s" totalImagesPullingTime="19.351140446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:44.602171402 +0000 UTC m=+23.934835845" watchObservedRunningTime="2026-07-13 21:09:44.602447961 +0000 UTC m=+23.935112401" Jul 13 21:09:44.619526 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.619473 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dr48r" podStartSLOduration=7.419953037 podStartE2EDuration="22.619459161s" totalImagesPullingTime="15.199506124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:44.619227791 +0000 UTC m=+23.951892231" watchObservedRunningTime="2026-07-13 21:09:44.619459161 +0000 UTC m=+23.952123612" Jul 13 21:09:44.635821 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:44.635775 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6jbbx" podStartSLOduration=3.248957794 podStartE2EDuration="22.635759538s" totalImagesPullingTime="19.386801744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:44.635424236 +0000 UTC m=+23.968088674" watchObservedRunningTime="2026-07-13 21:09:44.635759538 +0000 UTC m=+23.968423976" Jul 13 21:09:45.274213 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:45.274187 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:45.274369 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:45.274187 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:45.274369 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:45.274335 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:45.274473 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:45.274394 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:45.329111 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:45.329085 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 21:09:45.556337 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:45.556297 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" event={"ID":"21fdbe6d-3840-4061-82a1-5267f5e94e25","Type":"ContainerStarted","Data":"91694465c906a22102172fa6aec2849abeec848c2cf260622401fec8b6cf4f7b"} Jul 13 21:09:45.558072 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:45.558038 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lnl7m" event={"ID":"a29c809d-4076-4066-a33c-e804721344e9","Type":"ContainerStarted","Data":"2bcc2a46ed7c3c7e09627d845c6f3f4d9ff1ebc2518fadf6c8e95a9ebf7f57ca"} Jul 13 21:09:45.571927 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:45.571804 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lnl7m" podStartSLOduration=4.202121129 podStartE2EDuration="23.571784579s" totalImagesPullingTime="19.36966345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:45.57166806 +0000 UTC m=+24.904332502" watchObservedRunningTime="2026-07-13 21:09:45.571784579 +0000 UTC m=+24.904449021" Jul 13 21:09:46.207784 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:46.207700 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T21:09:45.32910655Z","UUID":"0b439b21-4039-4f89-9e69-60f3e4cfd7a4","Handler":null,"Name":"","Endpoint":""} Jul 13 21:09:46.209317 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:46.209297 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 21:09:46.209437 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:46.209336 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 21:09:46.274520 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:46.274490 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:46.274677 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:46.274627 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:46.562802 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:46.562776 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" event={"ID":"21fdbe6d-3840-4061-82a1-5267f5e94e25","Type":"ContainerStarted","Data":"859d4a34c3582c0644d39a12c72d4d702b99610db5574fb7cabb084bf5b61540"} Jul 13 21:09:46.591983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:46.591756 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpkr6" podStartSLOduration=2.956559054 podStartE2EDuration="24.591734182s" totalImagesPullingTime="21.635175128s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:46.591546996 +0000 UTC m=+25.924211441" watchObservedRunningTime="2026-07-13 21:09:46.591734182 +0000 UTC m=+25.924398624" Jul 13 21:09:47.274615 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:47.274357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:47.274802 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:47.274421 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:47.274802 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:47.274725 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:47.274934 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:47.274809 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:47.568976 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:47.568886 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" event={"ID":"44e3885c-dedd-4241-a1ac-863735f20219","Type":"ContainerStarted","Data":"0f5c923a371801d5dc9ff4a4a5f5cd0267af8330caf96d28fc29875c4ba798f6"} Jul 13 21:09:48.274345 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:48.274310 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:48.274577 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:48.274452 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:48.799076 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:48.799053 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dr48r" Jul 13 21:09:48.799978 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:48.799956 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dr48r" Jul 13 21:09:48.915337 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:48.915143 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dr48r" Jul 13 21:09:48.916044 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:48.915883 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dr48r" Jul 13 21:09:49.274746 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:49.274528 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:49.274924 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:49.274541 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:49.274924 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:49.274782 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:49.274924 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:49.274890 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:49.577413 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:49.577332 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" event={"ID":"44e3885c-dedd-4241-a1ac-863735f20219","Type":"ContainerStarted","Data":"4fef9d35433fb00ddbb1875186da7ee4dcb3ac3dc94a73be80f92e08e2296369"} Jul 13 21:09:49.577674 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:49.577643 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:49.579082 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:49.579058 2576 generic.go:356] "Generic (PLEG): container finished" podID="a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c" containerID="b61e07ccc8fe5ab9d3dbdcfb5242b390632a240225a9a63bd9621b630767b76b" exitCode=0 Jul 13 21:09:49.579168 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:49.579139 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2ch8" event={"ID":"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c","Type":"ContainerDied","Data":"b61e07ccc8fe5ab9d3dbdcfb5242b390632a240225a9a63bd9621b630767b76b"} Jul 13 21:09:49.593576 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:49.593549 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:49.604176 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:49.604130 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" podStartSLOduration=8.180097212 podStartE2EDuration="27.60411486s" totalImagesPullingTime="19.424017648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:49.604010368 +0000 UTC m=+28.936674809" watchObservedRunningTime="2026-07-13 21:09:49.60411486 +0000 UTC m=+28.936779301" Jul 13 21:09:50.273736 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:50.273707 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:50.274316 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:50.273843 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:50.582176 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:50.582149 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:50.582372 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:50.582238 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:50.600306 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:50.600285 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:09:50.777169 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:50.776975 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5t86b"] Jul 13 21:09:50.777394 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:50.777255 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:50.777394 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:50.777342 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:50.779975 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:50.779923 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-82gqz"] Jul 13 21:09:50.780116 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:50.780055 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:50.780222 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:50.780194 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:50.780512 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:50.780489 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lrpd6"] Jul 13 21:09:50.780594 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:50.780583 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:50.780691 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:50.780674 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:51.585916 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:51.585879 2576 generic.go:356] "Generic (PLEG): container finished" podID="a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c" containerID="1d8298600cbf25904537ceaf2afa32d6dd3e6e8f25a8c38b944385e240bf2895" exitCode=0 Jul 13 21:09:51.586378 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:51.585953 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2ch8" event={"ID":"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c","Type":"ContainerDied","Data":"1d8298600cbf25904537ceaf2afa32d6dd3e6e8f25a8c38b944385e240bf2895"} Jul 13 21:09:52.274108 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:52.274068 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:52.274108 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:52.274109 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:52.274324 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:52.274110 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:52.274324 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:52.274168 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:52.274324 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:52.274270 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:52.274437 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:52.274350 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:53.591994 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:53.591961 2576 generic.go:356] "Generic (PLEG): container finished" podID="a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c" containerID="049b1b3b9257706e8eb0eb816349b48e1c2977d3c32d82511db4384b36b459c5" exitCode=0 Jul 13 21:09:53.592623 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:53.592006 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2ch8" event={"ID":"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c","Type":"ContainerDied","Data":"049b1b3b9257706e8eb0eb816349b48e1c2977d3c32d82511db4384b36b459c5"} Jul 13 21:09:54.274081 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:54.274046 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:54.274081 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:54.274069 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:54.274309 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:54.274063 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:54.274309 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:54.274254 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:54.274377 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:54.274330 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:54.274431 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:54.274419 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:54.989839 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:54.989804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs\") pod \"network-metrics-daemon-lrpd6\" (UID: \"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180\") " pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:54.990290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:54.989872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:54.990290 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:54.989976 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:09:54.990290 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:54.989990 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 21:09:54.990290 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:54.990060 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret podName:1426ed32-f4b7-404b-bfaf-6b7df8984ec6 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:26.990042454 +0000 UTC m=+66.322706874 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret") pod "global-pull-secret-syncer-5t86b" (UID: "1426ed32-f4b7-404b-bfaf-6b7df8984ec6") : object "kube-system"/"original-pull-secret" not registered Jul 13 21:09:54.990290 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:54.990081 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs podName:08ad96d7-5c9a-4f9a-a5ad-64d3949f5180 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:26.990070648 +0000 UTC m=+66.322735067 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs") pod "network-metrics-daemon-lrpd6" (UID: "08ad96d7-5c9a-4f9a-a5ad-64d3949f5180") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:09:55.090499 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:55.090414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76sx\" (UniqueName: \"kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx\") pod \"network-check-target-82gqz\" (UID: \"2b98814f-5b72-4590-9aec-f15f1f82bdf9\") " pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:55.090651 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:55.090549 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 21:09:55.090651 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:55.090567 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 21:09:55.090651 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:55.090579 2576 projected.go:196] Error preparing data for projected volume kube-api-access-r76sx for pod openshift-network-diagnostics/network-check-target-82gqz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:09:55.090651 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:55.090638 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx podName:2b98814f-5b72-4590-9aec-f15f1f82bdf9 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:27.090620807 +0000 UTC m=+66.423285226 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r76sx" (UniqueName: "kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx") pod "network-check-target-82gqz" (UID: "2b98814f-5b72-4590-9aec-f15f1f82bdf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:09:56.273985 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.273949 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:56.273985 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.273971 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:56.273985 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.273977 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:56.274608 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:56.274070 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82gqz" podUID="2b98814f-5b72-4590-9aec-f15f1f82bdf9" Jul 13 21:09:56.274608 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:56.274151 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t86b" podUID="1426ed32-f4b7-404b-bfaf-6b7df8984ec6" Jul 13 21:09:56.274608 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:56.274213 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrpd6" podUID="08ad96d7-5c9a-4f9a-a5ad-64d3949f5180" Jul 13 21:09:56.453495 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.453463 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-136.ec2.internal" event="NodeReady" Jul 13 21:09:56.453661 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.453607 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 21:09:56.492678 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.492639 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bb4gv"] Jul 13 21:09:56.495304 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.495282 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bb4gv" Jul 13 21:09:56.498036 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.498006 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 21:09:56.498162 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.498092 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqhqf\"" Jul 13 21:09:56.498227 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.498216 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 21:09:56.499368 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.499340 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fxsfr"] Jul 13 21:09:56.500974 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.500954 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fxsfr" Jul 13 21:09:56.503922 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.503724 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rg67s\"" Jul 13 21:09:56.503922 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.503775 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 21:09:56.503922 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.503776 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 21:09:56.503922 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.503788 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 21:09:56.505180 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.504310 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bb4gv"] Jul 13 21:09:56.516305 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.516280 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fxsfr"] Jul 13 21:09:56.599167 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.599086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvqz6\" (UniqueName: \"kubernetes.io/projected/faec6492-b638-486e-aa9f-fe5c3d5807df-kube-api-access-zvqz6\") pod \"ingress-canary-fxsfr\" (UID: \"faec6492-b638-486e-aa9f-fe5c3d5807df\") " pod="openshift-ingress-canary/ingress-canary-fxsfr" Jul 13 21:09:56.599167 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.599121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fe1194f-2ccd-4288-ad07-602df2121359-config-volume\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:09:56.599167 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.599146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:09:56.599435 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.599167 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jgsh\" (UniqueName: \"kubernetes.io/projected/6fe1194f-2ccd-4288-ad07-602df2121359-kube-api-access-5jgsh\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:09:56.599435 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.599234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/faec6492-b638-486e-aa9f-fe5c3d5807df-cert\") pod \"ingress-canary-fxsfr\" (UID: \"faec6492-b638-486e-aa9f-fe5c3d5807df\") " pod="openshift-ingress-canary/ingress-canary-fxsfr" Jul 13 21:09:56.599435 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.599324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fe1194f-2ccd-4288-ad07-602df2121359-tmp-dir\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:09:56.699766 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.699727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fe1194f-2ccd-4288-ad07-602df2121359-tmp-dir\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:09:56.700012 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.699845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvqz6\" (UniqueName: \"kubernetes.io/projected/faec6492-b638-486e-aa9f-fe5c3d5807df-kube-api-access-zvqz6\") pod \"ingress-canary-fxsfr\" (UID: \"faec6492-b638-486e-aa9f-fe5c3d5807df\") " pod="openshift-ingress-canary/ingress-canary-fxsfr" Jul 13 21:09:56.700012 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.699892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fe1194f-2ccd-4288-ad07-602df2121359-config-volume\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:09:56.700012 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.699920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:09:56.700012 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.699945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jgsh\" (UniqueName: \"kubernetes.io/projected/6fe1194f-2ccd-4288-ad07-602df2121359-kube-api-access-5jgsh\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:09:56.700012 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.699971 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/faec6492-b638-486e-aa9f-fe5c3d5807df-cert\") pod \"ingress-canary-fxsfr\" (UID: \"faec6492-b638-486e-aa9f-fe5c3d5807df\") " pod="openshift-ingress-canary/ingress-canary-fxsfr" Jul 13 21:09:56.700271 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.700142 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fe1194f-2ccd-4288-ad07-602df2121359-tmp-dir\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:09:56.700271 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:56.700249 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 21:09:56.700361 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:56.700307 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls podName:6fe1194f-2ccd-4288-ad07-602df2121359 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:57.200286736 +0000 UTC m=+36.532951173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls") pod "dns-default-bb4gv" (UID: "6fe1194f-2ccd-4288-ad07-602df2121359") : secret "dns-default-metrics-tls" not found Jul 13 21:09:56.700765 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.700734 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fe1194f-2ccd-4288-ad07-602df2121359-config-volume\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:09:56.705131 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.705110 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/faec6492-b638-486e-aa9f-fe5c3d5807df-cert\") pod \"ingress-canary-fxsfr\" (UID: \"faec6492-b638-486e-aa9f-fe5c3d5807df\") " pod="openshift-ingress-canary/ingress-canary-fxsfr" Jul 13 21:09:56.708532 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.708506 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvqz6\" (UniqueName: \"kubernetes.io/projected/faec6492-b638-486e-aa9f-fe5c3d5807df-kube-api-access-zvqz6\") pod \"ingress-canary-fxsfr\" (UID: \"faec6492-b638-486e-aa9f-fe5c3d5807df\") " pod="openshift-ingress-canary/ingress-canary-fxsfr" Jul 13 21:09:56.708724 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.708645 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jgsh\" (UniqueName: \"kubernetes.io/projected/6fe1194f-2ccd-4288-ad07-602df2121359-kube-api-access-5jgsh\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:09:56.814195 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:56.814165 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fxsfr" Jul 13 21:09:57.205165 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:57.205128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:09:57.205341 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:57.205268 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 21:09:57.205341 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:57.205322 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls podName:6fe1194f-2ccd-4288-ad07-602df2121359 nodeName:}" failed. No retries permitted until 2026-07-13 21:09:58.205308373 +0000 UTC m=+37.537972795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls") pod "dns-default-bb4gv" (UID: "6fe1194f-2ccd-4288-ad07-602df2121359") : secret "dns-default-metrics-tls" not found Jul 13 21:09:57.643608 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:57.643370 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fxsfr"] Jul 13 21:09:57.648143 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:09:57.648111 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaec6492_b638_486e_aa9f_fe5c3d5807df.slice/crio-a348e595aefb275db01d741177e2d0e470e313bc13a84927bf05e2d739ebe52f WatchSource:0}: Error finding container a348e595aefb275db01d741177e2d0e470e313bc13a84927bf05e2d739ebe52f: Status 404 returned error can't find the container with id a348e595aefb275db01d741177e2d0e470e313bc13a84927bf05e2d739ebe52f Jul 13 21:09:58.211437 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:58.211406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:09:58.211599 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:58.211516 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 21:09:58.211599 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:09:58.211572 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls podName:6fe1194f-2ccd-4288-ad07-602df2121359 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:00.211556416 +0000 UTC m=+39.544220834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls") pod "dns-default-bb4gv" (UID: "6fe1194f-2ccd-4288-ad07-602df2121359") : secret "dns-default-metrics-tls" not found Jul 13 21:09:58.274320 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:58.274281 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:09:58.274320 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:58.274319 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:09:58.274553 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:58.274458 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:09:58.278025 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:58.277989 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 21:09:58.278164 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:58.278029 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fgl7x\"" Jul 13 21:09:58.278164 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:58.278038 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 21:09:58.278164 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:58.277988 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 21:09:58.278164 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:58.278136 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gq4dz\"" Jul 13 21:09:58.278164 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:58.278029 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 21:09:58.607838 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:58.607743 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fxsfr" event={"ID":"faec6492-b638-486e-aa9f-fe5c3d5807df","Type":"ContainerStarted","Data":"a348e595aefb275db01d741177e2d0e470e313bc13a84927bf05e2d739ebe52f"} Jul 13 21:09:58.611539 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:58.611509 2576 generic.go:356] "Generic (PLEG): container finished" podID="a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c" containerID="892fea02c3b402dcbb7ca7dc18411ecbc87fc5aa2d7c5ad95d6b7e17de759af7" exitCode=0 Jul 13 21:09:58.611676 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:58.611578 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2ch8" event={"ID":"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c","Type":"ContainerDied","Data":"892fea02c3b402dcbb7ca7dc18411ecbc87fc5aa2d7c5ad95d6b7e17de759af7"} Jul 13 21:09:59.617572 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:59.617535 2576 generic.go:356] "Generic (PLEG): container finished" podID="a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c" containerID="a32f5e8a77e171061f1cf3a90f7a892a5f3c3150fa35048798f3f2f48e19ce77" exitCode=0 Jul 13 21:09:59.617984 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:09:59.617578 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2ch8" event={"ID":"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c","Type":"ContainerDied","Data":"a32f5e8a77e171061f1cf3a90f7a892a5f3c3150fa35048798f3f2f48e19ce77"} Jul 13 21:10:00.230174 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:00.229980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:10:00.230337 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:00.230145 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 21:10:00.230337 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:00.230238 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls podName:6fe1194f-2ccd-4288-ad07-602df2121359 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:04.23021903 +0000 UTC m=+43.562883465 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls") pod "dns-default-bb4gv" (UID: "6fe1194f-2ccd-4288-ad07-602df2121359") : secret "dns-default-metrics-tls" not found Jul 13 21:10:00.621848 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:00.621753 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fxsfr" event={"ID":"faec6492-b638-486e-aa9f-fe5c3d5807df","Type":"ContainerStarted","Data":"cd38e03bcb151ee5c1d5c081330a7db448e5798154b0dbce43bd67e623120f38"} Jul 13 21:10:00.624944 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:00.624906 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2ch8" event={"ID":"a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c","Type":"ContainerStarted","Data":"185ad9dc5e20d546778ffa71b9d91dbc3ac9ea75baec7a5ad7f509c89cbcde7b"} Jul 13 21:10:00.636598 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:00.636554 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fxsfr" podStartSLOduration=2.420257769 podStartE2EDuration="4.636538747s" totalImagesPullingTime="2.216280978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:00.635807371 +0000 UTC m=+39.968471811" watchObservedRunningTime="2026-07-13 21:10:00.636538747 +0000 UTC m=+39.969203187" Jul 13 21:10:00.656114 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:00.656057 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b2ch8" podStartSLOduration=8.721493298 podStartE2EDuration="38.6560384s" totalImagesPullingTime="29.934545102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:00.654684445 +0000 UTC m=+39.987348885" watchObservedRunningTime="2026-07-13 21:10:00.6560384 +0000 UTC m=+39.988702842" Jul 13 21:10:04.257090 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.257052 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:10:04.257612 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:04.257174 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 21:10:04.257612 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:04.257225 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls podName:6fe1194f-2ccd-4288-ad07-602df2121359 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:12.257211442 +0000 UTC m=+51.589875861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls") pod "dns-default-bb4gv" (UID: "6fe1194f-2ccd-4288-ad07-602df2121359") : secret "dns-default-metrics-tls" not found Jul 13 21:10:04.800014 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.799981 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-47phg"] Jul 13 21:10:04.829245 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.829214 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-47phg"] Jul 13 21:10:04.829384 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.829313 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-47phg" Jul 13 21:10:04.831907 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.831885 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 13 21:10:04.832727 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.832707 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 13 21:10:04.832834 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.832766 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 13 21:10:04.832834 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.832770 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rp495\"" Jul 13 21:10:04.832834 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.832767 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 13 21:10:04.861777 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.861749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps7gs\" (UniqueName: \"kubernetes.io/projected/0e94300e-3c04-4a04-b2c8-db4c592b332a-kube-api-access-ps7gs\") pod \"service-ca-79f68b9f4f-47phg\" (UID: \"0e94300e-3c04-4a04-b2c8-db4c592b332a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-47phg" Jul 13 21:10:04.861927 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.861812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0e94300e-3c04-4a04-b2c8-db4c592b332a-signing-cabundle\") pod \"service-ca-79f68b9f4f-47phg\" (UID: \"0e94300e-3c04-4a04-b2c8-db4c592b332a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-47phg" Jul 13 21:10:04.861927 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.861899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0e94300e-3c04-4a04-b2c8-db4c592b332a-signing-key\") pod \"service-ca-79f68b9f4f-47phg\" (UID: \"0e94300e-3c04-4a04-b2c8-db4c592b332a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-47phg" Jul 13 21:10:04.963080 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.963044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0e94300e-3c04-4a04-b2c8-db4c592b332a-signing-cabundle\") pod \"service-ca-79f68b9f4f-47phg\" (UID: \"0e94300e-3c04-4a04-b2c8-db4c592b332a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-47phg" Jul 13 21:10:04.963221 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.963101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0e94300e-3c04-4a04-b2c8-db4c592b332a-signing-key\") pod \"service-ca-79f68b9f4f-47phg\" (UID: \"0e94300e-3c04-4a04-b2c8-db4c592b332a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-47phg" Jul 13 21:10:04.963221 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.963138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps7gs\" (UniqueName: \"kubernetes.io/projected/0e94300e-3c04-4a04-b2c8-db4c592b332a-kube-api-access-ps7gs\") pod \"service-ca-79f68b9f4f-47phg\" (UID: \"0e94300e-3c04-4a04-b2c8-db4c592b332a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-47phg" Jul 13 21:10:04.963692 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.963671 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0e94300e-3c04-4a04-b2c8-db4c592b332a-signing-cabundle\") pod \"service-ca-79f68b9f4f-47phg\" (UID: \"0e94300e-3c04-4a04-b2c8-db4c592b332a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-47phg" Jul 13 21:10:04.967148 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.967130 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0e94300e-3c04-4a04-b2c8-db4c592b332a-signing-key\") pod \"service-ca-79f68b9f4f-47phg\" (UID: \"0e94300e-3c04-4a04-b2c8-db4c592b332a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-47phg" Jul 13 21:10:04.971153 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:04.971128 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps7gs\" (UniqueName: \"kubernetes.io/projected/0e94300e-3c04-4a04-b2c8-db4c592b332a-kube-api-access-ps7gs\") pod \"service-ca-79f68b9f4f-47phg\" (UID: \"0e94300e-3c04-4a04-b2c8-db4c592b332a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-47phg" Jul 13 21:10:05.138409 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:05.138331 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-47phg" Jul 13 21:10:05.271162 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:05.271130 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-47phg"] Jul 13 21:10:05.274207 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:10:05.274159 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e94300e_3c04_4a04_b2c8_db4c592b332a.slice/crio-44eedc19dd2e98973a34405bf64356d4dd7a274619698be308ec6677624cfb02 WatchSource:0}: Error finding container 44eedc19dd2e98973a34405bf64356d4dd7a274619698be308ec6677624cfb02: Status 404 returned error can't find the container with id 44eedc19dd2e98973a34405bf64356d4dd7a274619698be308ec6677624cfb02 Jul 13 21:10:05.637279 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:05.637241 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-47phg" event={"ID":"0e94300e-3c04-4a04-b2c8-db4c592b332a","Type":"ContainerStarted","Data":"44eedc19dd2e98973a34405bf64356d4dd7a274619698be308ec6677624cfb02"} Jul 13 21:10:09.648521 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:09.648489 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-47phg" event={"ID":"0e94300e-3c04-4a04-b2c8-db4c592b332a","Type":"ContainerStarted","Data":"cb0d96f8f589e1fd15e3f8d7cae9dbf0084b05fc4b11757888996efdec830fd2"} Jul 13 21:10:09.664782 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:09.664733 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-47phg" podStartSLOduration=2.170436458 podStartE2EDuration="5.664717765s" totalImagesPullingTime="3.494281307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:09.663759767 +0000 UTC m=+48.996424207" watchObservedRunningTime="2026-07-13 21:10:09.664717765 +0000 UTC m=+48.997382207" Jul 13 21:10:12.316625 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:12.316591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:10:12.317033 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:12.316711 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 21:10:12.317033 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:12.316762 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls podName:6fe1194f-2ccd-4288-ad07-602df2121359 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:28.316747882 +0000 UTC m=+67.649412302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls") pod "dns-default-bb4gv" (UID: "6fe1194f-2ccd-4288-ad07-602df2121359") : secret "dns-default-metrics-tls" not found Jul 13 21:10:22.597832 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:22.597806 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgjsx" Jul 13 21:10:23.817876 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.817836 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lzrn6"] Jul 13 21:10:23.820419 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.820398 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lzrn6" Jul 13 21:10:23.826081 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.823620 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 13 21:10:23.826081 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.824697 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-cm7nl\"" Jul 13 21:10:23.826081 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.825004 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 13 21:10:23.833546 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.833521 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tcxwj"] Jul 13 21:10:23.835249 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.835228 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lzrn6"] Jul 13 21:10:23.835356 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.835304 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tcxwj" Jul 13 21:10:23.837967 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.837947 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 13 21:10:23.838234 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.838214 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 13 21:10:23.838315 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.838253 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 13 21:10:23.838836 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.838820 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vswv6\"" Jul 13 21:10:23.856917 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.856888 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tcxwj"] Jul 13 21:10:23.895021 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.894986 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/753b68e3-5e81-4450-b3e1-cce7f3a72924-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tcxwj\" (UID: \"753b68e3-5e81-4450-b3e1-cce7f3a72924\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tcxwj" Jul 13 21:10:23.895021 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.895022 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z64s7\" (UniqueName: \"kubernetes.io/projected/4a0ae7b2-73f7-42c4-8617-fdb2050fc09e-kube-api-access-z64s7\") pod \"volume-data-source-validator-78495597f6-lzrn6\" (UID: \"4a0ae7b2-73f7-42c4-8617-fdb2050fc09e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lzrn6" Jul 13 21:10:23.895217 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.895110 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tr47\" (UniqueName: \"kubernetes.io/projected/753b68e3-5e81-4450-b3e1-cce7f3a72924-kube-api-access-7tr47\") pod \"cluster-samples-operator-65db858894-tcxwj\" (UID: \"753b68e3-5e81-4450-b3e1-cce7f3a72924\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tcxwj" Jul 13 21:10:23.925749 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.925716 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-854b6c8876-kvs84"] Jul 13 21:10:23.927701 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.927681 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:23.933486 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.933346 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 13 21:10:23.934538 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.934517 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 13 21:10:23.934636 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.934543 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 13 21:10:23.934800 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.934785 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2l9mp\"" Jul 13 21:10:23.939744 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.939727 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 13 21:10:23.969642 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.969616 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-854b6c8876-kvs84"] Jul 13 21:10:23.996262 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.996235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/753b68e3-5e81-4450-b3e1-cce7f3a72924-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tcxwj\" (UID: \"753b68e3-5e81-4450-b3e1-cce7f3a72924\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tcxwj" Jul 13 21:10:23.996262 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.996267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z64s7\" (UniqueName: \"kubernetes.io/projected/4a0ae7b2-73f7-42c4-8617-fdb2050fc09e-kube-api-access-z64s7\") pod \"volume-data-source-validator-78495597f6-lzrn6\" (UID: \"4a0ae7b2-73f7-42c4-8617-fdb2050fc09e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lzrn6" Jul 13 21:10:23.996455 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.996304 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/541dafa8-bed7-492e-89e3-483fa362f228-registry-tls\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:23.996455 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.996322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/541dafa8-bed7-492e-89e3-483fa362f228-bound-sa-token\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:23.996455 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.996340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/541dafa8-bed7-492e-89e3-483fa362f228-ca-trust-extracted\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:23.996455 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.996378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/541dafa8-bed7-492e-89e3-483fa362f228-installation-pull-secrets\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:23.996455 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.996407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ql62\" (UniqueName: \"kubernetes.io/projected/541dafa8-bed7-492e-89e3-483fa362f228-kube-api-access-4ql62\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:23.996455 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.996456 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/541dafa8-bed7-492e-89e3-483fa362f228-trusted-ca\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:23.996663 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.996526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tr47\" (UniqueName: \"kubernetes.io/projected/753b68e3-5e81-4450-b3e1-cce7f3a72924-kube-api-access-7tr47\") pod \"cluster-samples-operator-65db858894-tcxwj\" (UID: \"753b68e3-5e81-4450-b3e1-cce7f3a72924\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tcxwj" Jul 13 21:10:23.996663 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.996553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/541dafa8-bed7-492e-89e3-483fa362f228-image-registry-private-configuration\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:23.996663 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.996572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/541dafa8-bed7-492e-89e3-483fa362f228-registry-certificates\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:23.998732 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:23.998712 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/753b68e3-5e81-4450-b3e1-cce7f3a72924-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tcxwj\" (UID: \"753b68e3-5e81-4450-b3e1-cce7f3a72924\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tcxwj" Jul 13 21:10:24.004180 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.004154 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z64s7\" (UniqueName: \"kubernetes.io/projected/4a0ae7b2-73f7-42c4-8617-fdb2050fc09e-kube-api-access-z64s7\") pod \"volume-data-source-validator-78495597f6-lzrn6\" (UID: \"4a0ae7b2-73f7-42c4-8617-fdb2050fc09e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lzrn6" Jul 13 21:10:24.004408 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.004387 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tr47\" (UniqueName: \"kubernetes.io/projected/753b68e3-5e81-4450-b3e1-cce7f3a72924-kube-api-access-7tr47\") pod \"cluster-samples-operator-65db858894-tcxwj\" (UID: \"753b68e3-5e81-4450-b3e1-cce7f3a72924\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tcxwj" Jul 13 21:10:24.097243 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.097159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/541dafa8-bed7-492e-89e3-483fa362f228-registry-tls\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.097243 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.097197 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/541dafa8-bed7-492e-89e3-483fa362f228-bound-sa-token\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.097243 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.097222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/541dafa8-bed7-492e-89e3-483fa362f228-ca-trust-extracted\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.097505 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.097247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/541dafa8-bed7-492e-89e3-483fa362f228-installation-pull-secrets\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.097505 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.097272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ql62\" (UniqueName: \"kubernetes.io/projected/541dafa8-bed7-492e-89e3-483fa362f228-kube-api-access-4ql62\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.097505 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.097300 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/541dafa8-bed7-492e-89e3-483fa362f228-trusted-ca\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.097505 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.097354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/541dafa8-bed7-492e-89e3-483fa362f228-image-registry-private-configuration\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.097505 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.097489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/541dafa8-bed7-492e-89e3-483fa362f228-registry-certificates\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.097754 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.097607 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/541dafa8-bed7-492e-89e3-483fa362f228-ca-trust-extracted\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.098229 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.098203 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/541dafa8-bed7-492e-89e3-483fa362f228-registry-certificates\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.098711 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.098685 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/541dafa8-bed7-492e-89e3-483fa362f228-trusted-ca\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.099941 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.099915 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/541dafa8-bed7-492e-89e3-483fa362f228-installation-pull-secrets\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.100035 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.100016 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/541dafa8-bed7-492e-89e3-483fa362f228-image-registry-private-configuration\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.100087 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.100013 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/541dafa8-bed7-492e-89e3-483fa362f228-registry-tls\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.107767 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.107748 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/541dafa8-bed7-492e-89e3-483fa362f228-bound-sa-token\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.108763 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.108748 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ql62\" (UniqueName: \"kubernetes.io/projected/541dafa8-bed7-492e-89e3-483fa362f228-kube-api-access-4ql62\") pod \"image-registry-854b6c8876-kvs84\" (UID: \"541dafa8-bed7-492e-89e3-483fa362f228\") " pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.130064 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.130034 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lzrn6" Jul 13 21:10:24.143990 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.143965 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tcxwj" Jul 13 21:10:24.236692 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.236659 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.261487 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.261451 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lzrn6"] Jul 13 21:10:24.264941 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:10:24.264783 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0ae7b2_73f7_42c4_8617_fdb2050fc09e.slice/crio-e1294f4da5156d0464cd13944bb5045e4cb3c5be362b0ddad130f4def879564c WatchSource:0}: Error finding container e1294f4da5156d0464cd13944bb5045e4cb3c5be362b0ddad130f4def879564c: Status 404 returned error can't find the container with id e1294f4da5156d0464cd13944bb5045e4cb3c5be362b0ddad130f4def879564c Jul 13 21:10:24.287160 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.287085 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tcxwj"] Jul 13 21:10:24.378000 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.377928 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-854b6c8876-kvs84"] Jul 13 21:10:24.380733 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:10:24.380708 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod541dafa8_bed7_492e_89e3_483fa362f228.slice/crio-c56e58e3f7b0c5a79b77e8a06b72a49935cab02ab27e674db2bf23727cb94e3e WatchSource:0}: Error finding container c56e58e3f7b0c5a79b77e8a06b72a49935cab02ab27e674db2bf23727cb94e3e: Status 404 returned error can't find the container with id c56e58e3f7b0c5a79b77e8a06b72a49935cab02ab27e674db2bf23727cb94e3e Jul 13 21:10:24.695838 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.695747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lzrn6" event={"ID":"4a0ae7b2-73f7-42c4-8617-fdb2050fc09e","Type":"ContainerStarted","Data":"e1294f4da5156d0464cd13944bb5045e4cb3c5be362b0ddad130f4def879564c"} Jul 13 21:10:24.697530 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.697504 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-854b6c8876-kvs84" event={"ID":"541dafa8-bed7-492e-89e3-483fa362f228","Type":"ContainerStarted","Data":"42188bd1667a20d740913c297beb0626162dea0e92aba3d06cac607a199d7cef"} Jul 13 21:10:24.697674 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.697547 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-854b6c8876-kvs84" event={"ID":"541dafa8-bed7-492e-89e3-483fa362f228","Type":"ContainerStarted","Data":"c56e58e3f7b0c5a79b77e8a06b72a49935cab02ab27e674db2bf23727cb94e3e"} Jul 13 21:10:24.697674 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.697623 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:24.698721 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.698701 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tcxwj" event={"ID":"753b68e3-5e81-4450-b3e1-cce7f3a72924","Type":"ContainerStarted","Data":"ec625e0dfd9d8e6030b0ecddc2197d6bb1d01dfefc3ca323ea05eee66df5db53"} Jul 13 21:10:24.716987 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:24.716935 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-854b6c8876-kvs84" podStartSLOduration=1.716915888 podStartE2EDuration="1.716915888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:24.715292591 +0000 UTC m=+64.047957032" watchObservedRunningTime="2026-07-13 21:10:24.716915888 +0000 UTC m=+64.049580330" Jul 13 21:10:25.702779 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:25.702739 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lzrn6" event={"ID":"4a0ae7b2-73f7-42c4-8617-fdb2050fc09e","Type":"ContainerStarted","Data":"6570fc15921daec23e413cbf79e479ebef210b9f64e2247565a01dd1db2b9468"} Jul 13 21:10:25.716298 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:25.716243 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lzrn6" podStartSLOduration=1.412177443 podStartE2EDuration="2.716228164s" totalImagesPullingTime="1.304050721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:25.716177901 +0000 UTC m=+65.048842341" watchObservedRunningTime="2026-07-13 21:10:25.716228164 +0000 UTC m=+65.048892595" Jul 13 21:10:26.707453 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:26.707417 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tcxwj" event={"ID":"753b68e3-5e81-4450-b3e1-cce7f3a72924","Type":"ContainerStarted","Data":"c69c4cef982a7f70603a2f2e2de16e3f757d075e1512f520673b88640de8f28e"} Jul 13 21:10:27.022910 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.022873 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs\") pod \"network-metrics-daemon-lrpd6\" (UID: \"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180\") " pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:10:27.023085 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.022918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:10:27.025214 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.025199 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 21:10:27.025268 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.025199 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 21:10:27.035153 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.035121 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1426ed32-f4b7-404b-bfaf-6b7df8984ec6-original-pull-secret\") pod \"global-pull-secret-syncer-5t86b\" (UID: \"1426ed32-f4b7-404b-bfaf-6b7df8984ec6\") " pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:10:27.035275 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.035256 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08ad96d7-5c9a-4f9a-a5ad-64d3949f5180-metrics-certs\") pod \"network-metrics-daemon-lrpd6\" (UID: \"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180\") " pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:10:27.086601 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.086570 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t86b" Jul 13 21:10:27.097731 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.097703 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fgl7x\"" Jul 13 21:10:27.105916 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.105893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrpd6" Jul 13 21:10:27.124150 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.124122 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76sx\" (UniqueName: \"kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx\") pod \"network-check-target-82gqz\" (UID: \"2b98814f-5b72-4590-9aec-f15f1f82bdf9\") " pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:10:27.126534 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.126512 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 21:10:27.136878 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.136690 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 21:10:27.148387 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.148360 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r76sx\" (UniqueName: \"kubernetes.io/projected/2b98814f-5b72-4590-9aec-f15f1f82bdf9-kube-api-access-r76sx\") pod \"network-check-target-82gqz\" (UID: \"2b98814f-5b72-4590-9aec-f15f1f82bdf9\") " pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:10:27.211544 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.211517 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5t86b"] Jul 13 21:10:27.213918 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:10:27.213891 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1426ed32_f4b7_404b_bfaf_6b7df8984ec6.slice/crio-9b432996511f91cd2244587d5b2ebb4108c46f04e264d9382956bfe76496d37f WatchSource:0}: Error finding container 9b432996511f91cd2244587d5b2ebb4108c46f04e264d9382956bfe76496d37f: Status 404 returned error can't find the container with id 9b432996511f91cd2244587d5b2ebb4108c46f04e264d9382956bfe76496d37f Jul 13 21:10:27.234851 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.234830 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lrpd6"] Jul 13 21:10:27.237006 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:10:27.236980 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08ad96d7_5c9a_4f9a_a5ad_64d3949f5180.slice/crio-87b01bfd0ed198d691d83bd1d0637adc496682e89c8d03379370eb157ad6357f WatchSource:0}: Error finding container 87b01bfd0ed198d691d83bd1d0637adc496682e89c8d03379370eb157ad6357f: Status 404 returned error can't find the container with id 87b01bfd0ed198d691d83bd1d0637adc496682e89c8d03379370eb157ad6357f Jul 13 21:10:27.404677 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.404585 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gq4dz\"" Jul 13 21:10:27.411618 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.411589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:10:27.531217 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.531186 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-82gqz"] Jul 13 21:10:27.534104 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:10:27.534080 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b98814f_5b72_4590_9aec_f15f1f82bdf9.slice/crio-0c91e59793947dae79b5a9185b345d841398f25da75c785065c41225ac0f7d07 WatchSource:0}: Error finding container 0c91e59793947dae79b5a9185b345d841398f25da75c785065c41225ac0f7d07: Status 404 returned error can't find the container with id 0c91e59793947dae79b5a9185b345d841398f25da75c785065c41225ac0f7d07 Jul 13 21:10:27.715363 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.715291 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tcxwj" event={"ID":"753b68e3-5e81-4450-b3e1-cce7f3a72924","Type":"ContainerStarted","Data":"de3a01f6697f1443255d70a87d1dac50eac3dc6ddfbb6bbf44791e15e65ff643"} Jul 13 21:10:27.717038 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.717007 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-82gqz" event={"ID":"2b98814f-5b72-4590-9aec-f15f1f82bdf9","Type":"ContainerStarted","Data":"0c91e59793947dae79b5a9185b345d841398f25da75c785065c41225ac0f7d07"} Jul 13 21:10:27.718370 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.718323 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lrpd6" event={"ID":"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180","Type":"ContainerStarted","Data":"87b01bfd0ed198d691d83bd1d0637adc496682e89c8d03379370eb157ad6357f"} Jul 13 21:10:27.719677 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.719654 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5t86b" event={"ID":"1426ed32-f4b7-404b-bfaf-6b7df8984ec6","Type":"ContainerStarted","Data":"9b432996511f91cd2244587d5b2ebb4108c46f04e264d9382956bfe76496d37f"} Jul 13 21:10:27.731498 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:27.731384 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tcxwj" podStartSLOduration=2.455261622 podStartE2EDuration="4.73136645s" totalImagesPullingTime="2.276104828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:27.731098991 +0000 UTC m=+67.063763436" watchObservedRunningTime="2026-07-13 21:10:27.73136645 +0000 UTC m=+67.064030894" Jul 13 21:10:28.333652 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:28.333604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:10:28.336331 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:28.336310 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fe1194f-2ccd-4288-ad07-602df2121359-metrics-tls\") pod \"dns-default-bb4gv\" (UID: \"6fe1194f-2ccd-4288-ad07-602df2121359\") " pod="openshift-dns/dns-default-bb4gv" Jul 13 21:10:28.610709 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:28.610671 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqhqf\"" Jul 13 21:10:28.618757 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:28.618727 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bb4gv" Jul 13 21:10:28.731580 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:28.731464 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lrpd6" event={"ID":"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180","Type":"ContainerStarted","Data":"eaeffce80d13739ac8ecdde0c626ca8fdc9edf45dd46449c6f0808bad4bab784"} Jul 13 21:10:28.731580 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:28.731529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lrpd6" event={"ID":"08ad96d7-5c9a-4f9a-a5ad-64d3949f5180","Type":"ContainerStarted","Data":"a7e20de1af28f6e86acc8f8826abc37d6079c19c1e58aacb4201e50bdaf54349"} Jul 13 21:10:28.750188 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:28.750127 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lrpd6" podStartSLOduration=65.806904464 podStartE2EDuration="1m6.750105893s" totalImagesPullingTime="943.201429ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:28.748071391 +0000 UTC m=+68.080735834" watchObservedRunningTime="2026-07-13 21:10:28.750105893 +0000 UTC m=+68.082770334" Jul 13 21:10:28.798737 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:28.798673 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bb4gv"] Jul 13 21:10:28.802579 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:10:28.802277 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe1194f_2ccd_4288_ad07_602df2121359.slice/crio-a44bf1132448986272b09f1d52de5d0be995f4864c671bcce1f16696368012e6 WatchSource:0}: Error finding container a44bf1132448986272b09f1d52de5d0be995f4864c671bcce1f16696368012e6: Status 404 returned error can't find the container with id a44bf1132448986272b09f1d52de5d0be995f4864c671bcce1f16696368012e6 Jul 13 21:10:29.737516 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:29.737399 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bb4gv" event={"ID":"6fe1194f-2ccd-4288-ad07-602df2121359","Type":"ContainerStarted","Data":"a44bf1132448986272b09f1d52de5d0be995f4864c671bcce1f16696368012e6"} Jul 13 21:10:32.127002 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.126966 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wbtcf"] Jul 13 21:10:32.130033 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.130009 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wbtcf" Jul 13 21:10:32.132552 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.132530 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 13 21:10:32.132668 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.132531 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qtt8m\"" Jul 13 21:10:32.142238 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.142212 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wbtcf"] Jul 13 21:10:32.163286 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.163228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/767e1f02-03b3-4939-91f2-7f5f4309964d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wbtcf\" (UID: \"767e1f02-03b3-4939-91f2-7f5f4309964d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wbtcf" Jul 13 21:10:32.264461 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.264419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/767e1f02-03b3-4939-91f2-7f5f4309964d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wbtcf\" (UID: \"767e1f02-03b3-4939-91f2-7f5f4309964d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wbtcf" Jul 13 21:10:32.264647 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:32.264570 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 13 21:10:32.264647 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:32.264643 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767e1f02-03b3-4939-91f2-7f5f4309964d-tls-certificates podName:767e1f02-03b3-4939-91f2-7f5f4309964d nodeName:}" failed. No retries permitted until 2026-07-13 21:10:32.764621843 +0000 UTC m=+72.097286276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/767e1f02-03b3-4939-91f2-7f5f4309964d-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-wbtcf" (UID: "767e1f02-03b3-4939-91f2-7f5f4309964d") : secret "prometheus-operator-admission-webhook-tls" not found Jul 13 21:10:32.540373 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.540337 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bgmwt"] Jul 13 21:10:32.542573 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.542548 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bgmwt" Jul 13 21:10:32.545163 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.545140 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-vh9lw\"" Jul 13 21:10:32.545342 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.545322 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 13 21:10:32.545422 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.545342 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 13 21:10:32.553293 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.553274 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bgmwt"] Jul 13 21:10:32.667298 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.667265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdxl8\" (UniqueName: \"kubernetes.io/projected/aab9f9e5-64cd-4890-87b5-f732507bb2af-kube-api-access-hdxl8\") pod \"migrator-7f59b54f6c-bgmwt\" (UID: \"aab9f9e5-64cd-4890-87b5-f732507bb2af\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bgmwt" Jul 13 21:10:32.768228 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.768190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/767e1f02-03b3-4939-91f2-7f5f4309964d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wbtcf\" (UID: \"767e1f02-03b3-4939-91f2-7f5f4309964d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wbtcf" Jul 13 21:10:32.768427 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.768286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdxl8\" (UniqueName: \"kubernetes.io/projected/aab9f9e5-64cd-4890-87b5-f732507bb2af-kube-api-access-hdxl8\") pod \"migrator-7f59b54f6c-bgmwt\" (UID: \"aab9f9e5-64cd-4890-87b5-f732507bb2af\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bgmwt" Jul 13 21:10:32.771264 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.771219 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/767e1f02-03b3-4939-91f2-7f5f4309964d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wbtcf\" (UID: \"767e1f02-03b3-4939-91f2-7f5f4309964d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wbtcf" Jul 13 21:10:32.776961 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.776924 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdxl8\" (UniqueName: \"kubernetes.io/projected/aab9f9e5-64cd-4890-87b5-f732507bb2af-kube-api-access-hdxl8\") pod \"migrator-7f59b54f6c-bgmwt\" (UID: \"aab9f9e5-64cd-4890-87b5-f732507bb2af\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bgmwt" Jul 13 21:10:32.853508 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:32.853485 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bgmwt" Jul 13 21:10:33.023590 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.021537 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bgmwt"] Jul 13 21:10:33.041929 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.041896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wbtcf" Jul 13 21:10:33.155297 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.155267 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-gqh8x"] Jul 13 21:10:33.157836 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.157815 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-gqh8x" Jul 13 21:10:33.160526 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.160507 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 21:10:33.160635 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.160545 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 21:10:33.160738 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.160709 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vz5rn\"" Jul 13 21:10:33.168237 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.168215 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-gqh8x"] Jul 13 21:10:33.171287 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.171268 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wbtcf"] Jul 13 21:10:33.174506 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:10:33.174485 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767e1f02_03b3_4939_91f2_7f5f4309964d.slice/crio-3ee285b7922db2013aedb41e84bf7421d803f9259d563aa3c8e1253544907693 WatchSource:0}: Error finding container 3ee285b7922db2013aedb41e84bf7421d803f9259d563aa3c8e1253544907693: Status 404 returned error can't find the container with id 3ee285b7922db2013aedb41e84bf7421d803f9259d563aa3c8e1253544907693 Jul 13 21:10:33.271590 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.271555 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hbd8\" (UniqueName: \"kubernetes.io/projected/d4a72567-3385-4112-9960-850384d34c8b-kube-api-access-2hbd8\") pod \"downloads-68c9cbb497-gqh8x\" (UID: \"d4a72567-3385-4112-9960-850384d34c8b\") " pod="openshift-console/downloads-68c9cbb497-gqh8x" Jul 13 21:10:33.372337 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.372249 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hbd8\" (UniqueName: \"kubernetes.io/projected/d4a72567-3385-4112-9960-850384d34c8b-kube-api-access-2hbd8\") pod \"downloads-68c9cbb497-gqh8x\" (UID: \"d4a72567-3385-4112-9960-850384d34c8b\") " pod="openshift-console/downloads-68c9cbb497-gqh8x" Jul 13 21:10:33.380042 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.380020 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hbd8\" (UniqueName: \"kubernetes.io/projected/d4a72567-3385-4112-9960-850384d34c8b-kube-api-access-2hbd8\") pod \"downloads-68c9cbb497-gqh8x\" (UID: \"d4a72567-3385-4112-9960-850384d34c8b\") " pod="openshift-console/downloads-68c9cbb497-gqh8x" Jul 13 21:10:33.466542 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.466504 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-gqh8x" Jul 13 21:10:33.587485 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.587450 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-gqh8x"] Jul 13 21:10:33.592102 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:10:33.592069 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4a72567_3385_4112_9960_850384d34c8b.slice/crio-dcba55a030577415633f5416720a6fed7faed437cebc1134b29945bad92e65d6 WatchSource:0}: Error finding container dcba55a030577415633f5416720a6fed7faed437cebc1134b29945bad92e65d6: Status 404 returned error can't find the container with id dcba55a030577415633f5416720a6fed7faed437cebc1134b29945bad92e65d6 Jul 13 21:10:33.647964 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.647885 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-njg2v"] Jul 13 21:10:33.650929 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.650910 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:33.653350 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.653302 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 21:10:33.653350 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.653302 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gz76z\"" Jul 13 21:10:33.653585 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.653570 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 21:10:33.653648 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.653615 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 21:10:33.653706 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.653678 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 21:10:33.662958 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.662932 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-njg2v"] Jul 13 21:10:33.753436 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.753399 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bgmwt" event={"ID":"aab9f9e5-64cd-4890-87b5-f732507bb2af","Type":"ContainerStarted","Data":"8f6f0ad2b6465a5a86cc4160c4f54c04b9369ded5b6e9e62376db010fed609a1"} Jul 13 21:10:33.754756 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.754732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-82gqz" event={"ID":"2b98814f-5b72-4590-9aec-f15f1f82bdf9","Type":"ContainerStarted","Data":"9d1608d4922647d1a5d1d24ec6f3ee3502bc5a8e7821d0e95c2773fc53c757de"} Jul 13 21:10:33.754906 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.754825 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:10:33.755880 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.755847 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-gqh8x" event={"ID":"d4a72567-3385-4112-9960-850384d34c8b","Type":"ContainerStarted","Data":"dcba55a030577415633f5416720a6fed7faed437cebc1134b29945bad92e65d6"} Jul 13 21:10:33.756790 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.756775 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wbtcf" event={"ID":"767e1f02-03b3-4939-91f2-7f5f4309964d","Type":"ContainerStarted","Data":"3ee285b7922db2013aedb41e84bf7421d803f9259d563aa3c8e1253544907693"} Jul 13 21:10:33.758116 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.758096 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5t86b" event={"ID":"1426ed32-f4b7-404b-bfaf-6b7df8984ec6","Type":"ContainerStarted","Data":"bc264b3e9cf555e40a3513c633b821c92b8cba4fb8b6efb61a5274ab6ba05b8b"} Jul 13 21:10:33.759790 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.759772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bb4gv" event={"ID":"6fe1194f-2ccd-4288-ad07-602df2121359","Type":"ContainerStarted","Data":"ce036ab66d2fd2cb078e78cc7e81d7089086d71a7c0fc8201ddbb6f252b011f8"} Jul 13 21:10:33.759904 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.759811 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bb4gv" event={"ID":"6fe1194f-2ccd-4288-ad07-602df2121359","Type":"ContainerStarted","Data":"7d895b3d2616b7388d62e83336fc456569fe060216ecec291c58afd0160f00f0"} Jul 13 21:10:33.759904 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.759881 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bb4gv" Jul 13 21:10:33.769184 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.769126 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-82gqz" podStartSLOduration=66.475459333 podStartE2EDuration="1m11.769111788s" totalImagesPullingTime="5.293652455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:33.768772274 +0000 UTC m=+73.101436717" watchObservedRunningTime="2026-07-13 21:10:33.769111788 +0000 UTC m=+73.101776231" Jul 13 21:10:33.774732 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.774711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ad6c5ea-3153-4c62-99de-0391c67b608d-data-volume\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:33.774816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.774744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qtnf\" (UniqueName: \"kubernetes.io/projected/6ad6c5ea-3153-4c62-99de-0391c67b608d-kube-api-access-2qtnf\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:33.774816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.774770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ad6c5ea-3153-4c62-99de-0391c67b608d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:33.774903 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.774816 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ad6c5ea-3153-4c62-99de-0391c67b608d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:33.774943 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.774919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ad6c5ea-3153-4c62-99de-0391c67b608d-crio-socket\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:33.783126 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.783087 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5t86b" podStartSLOduration=66.157045534 podStartE2EDuration="1m11.78307331s" totalImagesPullingTime="5.626027776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:33.78290472 +0000 UTC m=+73.115569158" watchObservedRunningTime="2026-07-13 21:10:33.78307331 +0000 UTC m=+73.115737751" Jul 13 21:10:33.801661 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.801619 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bb4gv" podStartSLOduration=33.773836438000004 podStartE2EDuration="37.801604429s" totalImagesPullingTime="4.027767991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:33.800488944 +0000 UTC m=+73.133153386" watchObservedRunningTime="2026-07-13 21:10:33.801604429 +0000 UTC m=+73.134268871" Jul 13 21:10:33.875943 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.875904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ad6c5ea-3153-4c62-99de-0391c67b608d-data-volume\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:33.875943 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.875946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qtnf\" (UniqueName: \"kubernetes.io/projected/6ad6c5ea-3153-4c62-99de-0391c67b608d-kube-api-access-2qtnf\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:33.876204 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.875979 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ad6c5ea-3153-4c62-99de-0391c67b608d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:33.876204 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.876007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ad6c5ea-3153-4c62-99de-0391c67b608d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:33.876204 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.876062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ad6c5ea-3153-4c62-99de-0391c67b608d-crio-socket\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:33.876204 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.876148 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ad6c5ea-3153-4c62-99de-0391c67b608d-crio-socket\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:33.876395 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.876279 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ad6c5ea-3153-4c62-99de-0391c67b608d-data-volume\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:33.876395 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:33.876360 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 21:10:33.876488 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:33.876396 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 21:10:33.876488 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:33.876432 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ad6c5ea-3153-4c62-99de-0391c67b608d-insights-runtime-extractor-tls podName:6ad6c5ea-3153-4c62-99de-0391c67b608d nodeName:}" failed. No retries permitted until 2026-07-13 21:10:34.376409426 +0000 UTC m=+73.709073857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ad6c5ea-3153-4c62-99de-0391c67b608d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-njg2v" (UID: "6ad6c5ea-3153-4c62-99de-0391c67b608d") : secret "insights-runtime-extractor-tls" not found Jul 13 21:10:33.876488 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:33.876463 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ad6c5ea-3153-4c62-99de-0391c67b608d-kube-rbac-proxy-cm podName:6ad6c5ea-3153-4c62-99de-0391c67b608d nodeName:}" failed. No retries permitted until 2026-07-13 21:10:34.376445632 +0000 UTC m=+73.709110075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ad6c5ea-3153-4c62-99de-0391c67b608d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-njg2v" (UID: "6ad6c5ea-3153-4c62-99de-0391c67b608d") : configmap "kube-rbac-proxy" not found Jul 13 21:10:33.886421 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:33.886382 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qtnf\" (UniqueName: \"kubernetes.io/projected/6ad6c5ea-3153-4c62-99de-0391c67b608d-kube-api-access-2qtnf\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:34.379713 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:34.379673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ad6c5ea-3153-4c62-99de-0391c67b608d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:34.380231 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:34.379739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ad6c5ea-3153-4c62-99de-0391c67b608d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:34.380231 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:34.379820 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 21:10:34.380231 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:34.379877 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 21:10:34.380231 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:34.379918 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ad6c5ea-3153-4c62-99de-0391c67b608d-kube-rbac-proxy-cm podName:6ad6c5ea-3153-4c62-99de-0391c67b608d nodeName:}" failed. No retries permitted until 2026-07-13 21:10:35.379899367 +0000 UTC m=+74.712563790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ad6c5ea-3153-4c62-99de-0391c67b608d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-njg2v" (UID: "6ad6c5ea-3153-4c62-99de-0391c67b608d") : configmap "kube-rbac-proxy" not found Jul 13 21:10:34.380231 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:34.379968 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ad6c5ea-3153-4c62-99de-0391c67b608d-insights-runtime-extractor-tls podName:6ad6c5ea-3153-4c62-99de-0391c67b608d nodeName:}" failed. No retries permitted until 2026-07-13 21:10:35.379950927 +0000 UTC m=+74.712615363 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ad6c5ea-3153-4c62-99de-0391c67b608d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-njg2v" (UID: "6ad6c5ea-3153-4c62-99de-0391c67b608d") : secret "insights-runtime-extractor-tls" not found Jul 13 21:10:34.766354 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:34.766316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wbtcf" event={"ID":"767e1f02-03b3-4939-91f2-7f5f4309964d","Type":"ContainerStarted","Data":"a3c088b65481f16ccd3e235b28c954cb1a3da18afaaff1285e3f462769e24a9f"} Jul 13 21:10:34.766565 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:34.766542 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wbtcf" Jul 13 21:10:34.772790 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:34.772765 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wbtcf" Jul 13 21:10:34.784045 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:34.783993 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wbtcf" podStartSLOduration=1.480081149 podStartE2EDuration="2.783973522s" totalImagesPullingTime="1.303892373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:34.782401607 +0000 UTC m=+74.115066048" watchObservedRunningTime="2026-07-13 21:10:34.783973522 +0000 UTC m=+74.116637963" Jul 13 21:10:35.060380 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.060359 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bb4gv_6fe1194f-2ccd-4288-ad07-602df2121359/dns/0.log" Jul 13 21:10:35.189190 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.189158 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-vgl89"] Jul 13 21:10:35.191399 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.191379 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" Jul 13 21:10:35.195357 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.195335 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gzh4l\"" Jul 13 21:10:35.195502 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.195437 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 21:10:35.195567 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.195540 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 13 21:10:35.195621 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.195577 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 13 21:10:35.195906 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.195888 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 21:10:35.195990 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.195944 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 21:10:35.210386 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.210352 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-vgl89"] Jul 13 21:10:35.242448 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.242422 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bb4gv_6fe1194f-2ccd-4288-ad07-602df2121359/kube-rbac-proxy/0.log" Jul 13 21:10:35.287277 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.287196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a91f6c22-8fb6-4d89-ad47-84aaa6859846-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-vgl89\" (UID: \"a91f6c22-8fb6-4d89-ad47-84aaa6859846\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" Jul 13 21:10:35.287277 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.287234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gb88\" (UniqueName: \"kubernetes.io/projected/a91f6c22-8fb6-4d89-ad47-84aaa6859846-kube-api-access-4gb88\") pod \"prometheus-operator-64785b6675-vgl89\" (UID: \"a91f6c22-8fb6-4d89-ad47-84aaa6859846\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" Jul 13 21:10:35.287464 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.287298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a91f6c22-8fb6-4d89-ad47-84aaa6859846-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-vgl89\" (UID: \"a91f6c22-8fb6-4d89-ad47-84aaa6859846\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" Jul 13 21:10:35.287464 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.287332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a91f6c22-8fb6-4d89-ad47-84aaa6859846-metrics-client-ca\") pod \"prometheus-operator-64785b6675-vgl89\" (UID: \"a91f6c22-8fb6-4d89-ad47-84aaa6859846\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" Jul 13 21:10:35.388579 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.388540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a91f6c22-8fb6-4d89-ad47-84aaa6859846-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-vgl89\" (UID: \"a91f6c22-8fb6-4d89-ad47-84aaa6859846\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" Jul 13 21:10:35.388579 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.388581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gb88\" (UniqueName: \"kubernetes.io/projected/a91f6c22-8fb6-4d89-ad47-84aaa6859846-kube-api-access-4gb88\") pod \"prometheus-operator-64785b6675-vgl89\" (UID: \"a91f6c22-8fb6-4d89-ad47-84aaa6859846\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" Jul 13 21:10:35.389146 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.388633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a91f6c22-8fb6-4d89-ad47-84aaa6859846-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-vgl89\" (UID: \"a91f6c22-8fb6-4d89-ad47-84aaa6859846\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" Jul 13 21:10:35.389146 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.388660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a91f6c22-8fb6-4d89-ad47-84aaa6859846-metrics-client-ca\") pod \"prometheus-operator-64785b6675-vgl89\" (UID: \"a91f6c22-8fb6-4d89-ad47-84aaa6859846\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" Jul 13 21:10:35.389146 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.388694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ad6c5ea-3153-4c62-99de-0391c67b608d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:35.389146 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.388727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ad6c5ea-3153-4c62-99de-0391c67b608d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:35.389146 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:35.388833 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 21:10:35.389146 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:35.388913 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ad6c5ea-3153-4c62-99de-0391c67b608d-insights-runtime-extractor-tls podName:6ad6c5ea-3153-4c62-99de-0391c67b608d nodeName:}" failed. No retries permitted until 2026-07-13 21:10:37.388893728 +0000 UTC m=+76.721558161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ad6c5ea-3153-4c62-99de-0391c67b608d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-njg2v" (UID: "6ad6c5ea-3153-4c62-99de-0391c67b608d") : secret "insights-runtime-extractor-tls" not found Jul 13 21:10:35.389146 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:35.389105 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 21:10:35.389517 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:35.389176 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ad6c5ea-3153-4c62-99de-0391c67b608d-kube-rbac-proxy-cm podName:6ad6c5ea-3153-4c62-99de-0391c67b608d nodeName:}" failed. No retries permitted until 2026-07-13 21:10:37.389157224 +0000 UTC m=+76.721821646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ad6c5ea-3153-4c62-99de-0391c67b608d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-njg2v" (UID: "6ad6c5ea-3153-4c62-99de-0391c67b608d") : configmap "kube-rbac-proxy" not found Jul 13 21:10:35.389579 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.389546 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a91f6c22-8fb6-4d89-ad47-84aaa6859846-metrics-client-ca\") pod \"prometheus-operator-64785b6675-vgl89\" (UID: \"a91f6c22-8fb6-4d89-ad47-84aaa6859846\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" Jul 13 21:10:35.391708 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.391675 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a91f6c22-8fb6-4d89-ad47-84aaa6859846-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-vgl89\" (UID: \"a91f6c22-8fb6-4d89-ad47-84aaa6859846\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" Jul 13 21:10:35.391838 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.391775 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a91f6c22-8fb6-4d89-ad47-84aaa6859846-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-vgl89\" (UID: \"a91f6c22-8fb6-4d89-ad47-84aaa6859846\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" Jul 13 21:10:35.397555 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.397531 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gb88\" (UniqueName: \"kubernetes.io/projected/a91f6c22-8fb6-4d89-ad47-84aaa6859846-kube-api-access-4gb88\") pod \"prometheus-operator-64785b6675-vgl89\" (UID: \"a91f6c22-8fb6-4d89-ad47-84aaa6859846\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" Jul 13 21:10:35.502673 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.502642 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" Jul 13 21:10:35.627557 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.627451 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-vgl89"] Jul 13 21:10:35.630023 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:10:35.629994 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda91f6c22_8fb6_4d89_ad47_84aaa6859846.slice/crio-5666ca5d9362301b68d9017f17fe921b9da34def4dfde04e710d30fabe394bd4 WatchSource:0}: Error finding container 5666ca5d9362301b68d9017f17fe921b9da34def4dfde04e710d30fabe394bd4: Status 404 returned error can't find the container with id 5666ca5d9362301b68d9017f17fe921b9da34def4dfde04e710d30fabe394bd4 Jul 13 21:10:35.771095 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.771058 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" event={"ID":"a91f6c22-8fb6-4d89-ad47-84aaa6859846","Type":"ContainerStarted","Data":"5666ca5d9362301b68d9017f17fe921b9da34def4dfde04e710d30fabe394bd4"} Jul 13 21:10:35.772622 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.772597 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bgmwt" event={"ID":"aab9f9e5-64cd-4890-87b5-f732507bb2af","Type":"ContainerStarted","Data":"a10439709ee598e283cd030128695e643809ae18da3f5da8eac8cfa8f9babbe0"} Jul 13 21:10:35.772766 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.772640 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bgmwt" event={"ID":"aab9f9e5-64cd-4890-87b5-f732507bb2af","Type":"ContainerStarted","Data":"cc4da935fae5d63cbc1ecb96773fe661802650cc220ea51bd079e6a1e2435d23"} Jul 13 21:10:35.788438 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:35.788394 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bgmwt" podStartSLOduration=1.8931711839999998 podStartE2EDuration="3.788380108s" totalImagesPullingTime="1.895208924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:35.78713405 +0000 UTC m=+75.119798491" watchObservedRunningTime="2026-07-13 21:10:35.788380108 +0000 UTC m=+75.121044548" Jul 13 21:10:36.442216 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:36.442182 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ndm6s_69296318-76d8-464f-88cb-eca82b0cb0f7/dns-node-resolver/0.log" Jul 13 21:10:37.243911 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:37.243834 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-854b6c8876-kvs84_541dafa8-bed7-492e-89e3-483fa362f228/registry/0.log" Jul 13 21:10:37.406888 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:37.406776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ad6c5ea-3153-4c62-99de-0391c67b608d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:37.406888 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:37.406827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ad6c5ea-3153-4c62-99de-0391c67b608d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:37.407114 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:37.406958 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 21:10:37.407114 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:37.407021 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ad6c5ea-3153-4c62-99de-0391c67b608d-insights-runtime-extractor-tls podName:6ad6c5ea-3153-4c62-99de-0391c67b608d nodeName:}" failed. No retries permitted until 2026-07-13 21:10:41.407003459 +0000 UTC m=+80.739667882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ad6c5ea-3153-4c62-99de-0391c67b608d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-njg2v" (UID: "6ad6c5ea-3153-4c62-99de-0391c67b608d") : secret "insights-runtime-extractor-tls" not found Jul 13 21:10:37.407547 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:37.407507 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ad6c5ea-3153-4c62-99de-0391c67b608d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:37.787597 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:37.787557 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" event={"ID":"a91f6c22-8fb6-4d89-ad47-84aaa6859846","Type":"ContainerStarted","Data":"0f07ae1509361a71a6b2ebfd516e5277dba8285f75093f593cb79af78fdda811"} Jul 13 21:10:37.788091 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:37.787645 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" event={"ID":"a91f6c22-8fb6-4d89-ad47-84aaa6859846","Type":"ContainerStarted","Data":"e34d906a5120a693701ad702954f32937e4d2f58187999c567a71e6ebd40c903"} Jul 13 21:10:37.803780 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:37.803718 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-vgl89" podStartSLOduration=1.370980797 podStartE2EDuration="2.80369788s" totalImagesPullingTime="1.432717083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:37.803305823 +0000 UTC m=+77.135970266" watchObservedRunningTime="2026-07-13 21:10:37.80369788 +0000 UTC m=+77.136362321" Jul 13 21:10:37.841910 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:37.841880 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vv2g9_989d6b5b-c88c-49a5-b4bb-16512682dddd/node-ca/0.log" Jul 13 21:10:38.242659 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:38.242630 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fxsfr_faec6492-b638-486e-aa9f-fe5c3d5807df/serve-healthcheck-canary/0.log" Jul 13 21:10:38.842391 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:38.842361 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-bgmwt_aab9f9e5-64cd-4890-87b5-f732507bb2af/migrator/0.log" Jul 13 21:10:39.042921 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.042893 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-bgmwt_aab9f9e5-64cd-4890-87b5-f732507bb2af/graceful-termination/0.log" Jul 13 21:10:39.538835 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.538791 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb"] Jul 13 21:10:39.541725 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.541699 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" Jul 13 21:10:39.545033 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.544925 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-85x9s\"" Jul 13 21:10:39.545158 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.545135 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 13 21:10:39.545386 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.545364 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 13 21:10:39.550399 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.550324 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb"] Jul 13 21:10:39.559008 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.558980 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m8mmg"] Jul 13 21:10:39.562095 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.562065 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.565844 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.565823 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 21:10:39.565974 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.565885 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 21:10:39.566036 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.565976 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 21:10:39.566036 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.565832 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cwc9r\"" Jul 13 21:10:39.626913 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.626728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-tls\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.626913 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.626770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3453caf8-27a6-4020-8852-43075d64287d-sys\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.626913 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.626795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3453caf8-27a6-4020-8852-43075d64287d-root\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.626913 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.626829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef8a4e7c-533a-43cf-b317-2947e7f40bbd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7x8nb\" (UID: \"ef8a4e7c-533a-43cf-b317-2947e7f40bbd\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" Jul 13 21:10:39.627234 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.626932 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef8a4e7c-533a-43cf-b317-2947e7f40bbd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7x8nb\" (UID: \"ef8a4e7c-533a-43cf-b317-2947e7f40bbd\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" Jul 13 21:10:39.627234 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.626978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-wtmp\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.627234 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.627001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3453caf8-27a6-4020-8852-43075d64287d-metrics-client-ca\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.627234 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.627031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-488sf\" (UniqueName: \"kubernetes.io/projected/ef8a4e7c-533a-43cf-b317-2947e7f40bbd-kube-api-access-488sf\") pod \"openshift-state-metrics-84bd68b896-7x8nb\" (UID: \"ef8a4e7c-533a-43cf-b317-2947e7f40bbd\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" Jul 13 21:10:39.627234 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.627069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-textfile\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.627234 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.627093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.627234 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.627123 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef8a4e7c-533a-43cf-b317-2947e7f40bbd-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7x8nb\" (UID: \"ef8a4e7c-533a-43cf-b317-2947e7f40bbd\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" Jul 13 21:10:39.627234 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.627145 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-accelerators-collector-config\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.627234 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.627163 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7v2t\" (UniqueName: \"kubernetes.io/projected/3453caf8-27a6-4020-8852-43075d64287d-kube-api-access-g7v2t\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.728236 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.728195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef8a4e7c-533a-43cf-b317-2947e7f40bbd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7x8nb\" (UID: \"ef8a4e7c-533a-43cf-b317-2947e7f40bbd\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" Jul 13 21:10:39.728431 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.728265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef8a4e7c-533a-43cf-b317-2947e7f40bbd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7x8nb\" (UID: \"ef8a4e7c-533a-43cf-b317-2947e7f40bbd\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" Jul 13 21:10:39.728431 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.728319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-wtmp\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.728431 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.728348 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3453caf8-27a6-4020-8852-43075d64287d-metrics-client-ca\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.728431 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.728376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-488sf\" (UniqueName: \"kubernetes.io/projected/ef8a4e7c-533a-43cf-b317-2947e7f40bbd-kube-api-access-488sf\") pod \"openshift-state-metrics-84bd68b896-7x8nb\" (UID: \"ef8a4e7c-533a-43cf-b317-2947e7f40bbd\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" Jul 13 21:10:39.728431 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.728402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-textfile\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.728431 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.728424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.728761 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:39.728428 2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 13 21:10:39.728761 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.728457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef8a4e7c-533a-43cf-b317-2947e7f40bbd-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7x8nb\" (UID: \"ef8a4e7c-533a-43cf-b317-2947e7f40bbd\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" Jul 13 21:10:39.728761 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.728484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-accelerators-collector-config\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.728761 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:39.728504 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8a4e7c-533a-43cf-b317-2947e7f40bbd-openshift-state-metrics-tls podName:ef8a4e7c-533a-43cf-b317-2947e7f40bbd nodeName:}" failed. No retries permitted until 2026-07-13 21:10:40.228483553 +0000 UTC m=+79.561147989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ef8a4e7c-533a-43cf-b317-2947e7f40bbd-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-7x8nb" (UID: "ef8a4e7c-533a-43cf-b317-2947e7f40bbd") : secret "openshift-state-metrics-tls" not found Jul 13 21:10:39.728996 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.728937 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-wtmp\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.729640 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.729112 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-accelerators-collector-config\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.729640 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.729164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7v2t\" (UniqueName: \"kubernetes.io/projected/3453caf8-27a6-4020-8852-43075d64287d-kube-api-access-g7v2t\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.729640 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.729204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-tls\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.729640 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.729228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3453caf8-27a6-4020-8852-43075d64287d-sys\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.729640 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.729254 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3453caf8-27a6-4020-8852-43075d64287d-root\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.729640 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.729336 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3453caf8-27a6-4020-8852-43075d64287d-root\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.729640 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.729401 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3453caf8-27a6-4020-8852-43075d64287d-metrics-client-ca\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.729640 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:39.729501 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 13 21:10:39.729640 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:39.729544 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-tls podName:3453caf8-27a6-4020-8852-43075d64287d nodeName:}" failed. No retries permitted until 2026-07-13 21:10:40.22952963 +0000 UTC m=+79.562194052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-tls") pod "node-exporter-m8mmg" (UID: "3453caf8-27a6-4020-8852-43075d64287d") : secret "node-exporter-tls" not found Jul 13 21:10:39.729640 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.729583 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3453caf8-27a6-4020-8852-43075d64287d-sys\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.730315 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.729849 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef8a4e7c-533a-43cf-b317-2947e7f40bbd-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7x8nb\" (UID: \"ef8a4e7c-533a-43cf-b317-2947e7f40bbd\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" Jul 13 21:10:39.730315 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.730116 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-textfile\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.731270 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.731246 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef8a4e7c-533a-43cf-b317-2947e7f40bbd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7x8nb\" (UID: \"ef8a4e7c-533a-43cf-b317-2947e7f40bbd\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" Jul 13 21:10:39.731382 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.731363 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.739239 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.739208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7v2t\" (UniqueName: \"kubernetes.io/projected/3453caf8-27a6-4020-8852-43075d64287d-kube-api-access-g7v2t\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:39.739353 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:39.739338 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-488sf\" (UniqueName: \"kubernetes.io/projected/ef8a4e7c-533a-43cf-b317-2947e7f40bbd-kube-api-access-488sf\") pod \"openshift-state-metrics-84bd68b896-7x8nb\" (UID: \"ef8a4e7c-533a-43cf-b317-2947e7f40bbd\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" Jul 13 21:10:40.234193 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.234153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef8a4e7c-533a-43cf-b317-2947e7f40bbd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7x8nb\" (UID: \"ef8a4e7c-533a-43cf-b317-2947e7f40bbd\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" Jul 13 21:10:40.234656 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.234247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-tls\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:40.236872 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.236822 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3453caf8-27a6-4020-8852-43075d64287d-node-exporter-tls\") pod \"node-exporter-m8mmg\" (UID: \"3453caf8-27a6-4020-8852-43075d64287d\") " pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:40.237034 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.237010 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef8a4e7c-533a-43cf-b317-2947e7f40bbd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7x8nb\" (UID: \"ef8a4e7c-533a-43cf-b317-2947e7f40bbd\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" Jul 13 21:10:40.455050 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.455020 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" Jul 13 21:10:40.475728 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.475690 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m8mmg" Jul 13 21:10:40.611899 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.611843 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 21:10:40.615009 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.614987 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.620459 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.617721 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 13 21:10:40.620459 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.617954 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 13 21:10:40.620459 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.618188 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 13 21:10:40.620459 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.618218 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 13 21:10:40.620459 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.618807 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 13 21:10:40.620459 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.618897 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 13 21:10:40.620459 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.619125 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 13 21:10:40.620459 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.619439 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 13 21:10:40.620459 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.620262 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 13 21:10:40.621811 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.621692 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lcxxm\"" Jul 13 21:10:40.626353 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.625953 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb"] Jul 13 21:10:40.631449 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:10:40.631421 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef8a4e7c_533a_43cf_b317_2947e7f40bbd.slice/crio-9a04dea6d83c5c4b87e8d383e125d13bb175c077cc781800b433ee8024a13229 WatchSource:0}: Error finding container 9a04dea6d83c5c4b87e8d383e125d13bb175c077cc781800b433ee8024a13229: Status 404 returned error can't find the container with id 9a04dea6d83c5c4b87e8d383e125d13bb175c077cc781800b433ee8024a13229 Jul 13 21:10:40.632695 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.632675 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 21:10:40.740162 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.740078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjqt7\" (UniqueName: \"kubernetes.io/projected/480b4617-6143-4d19-9417-5527b951d348-kube-api-access-hjqt7\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.740162 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.740127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.740368 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.740165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/480b4617-6143-4d19-9417-5527b951d348-config-out\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.740368 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.740188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/480b4617-6143-4d19-9417-5527b951d348-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.740368 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.740223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.740368 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.740250 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-web-config\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.740368 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.740272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/480b4617-6143-4d19-9417-5527b951d348-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.740368 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.740360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/480b4617-6143-4d19-9417-5527b951d348-tls-assets\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.740658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.740385 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/480b4617-6143-4d19-9417-5527b951d348-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.740658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.740414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-config-volume\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.740658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.740478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.740658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.740526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.740658 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.740554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.801365 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.801328 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m8mmg" event={"ID":"3453caf8-27a6-4020-8852-43075d64287d","Type":"ContainerStarted","Data":"8fdd7631f4c1a06aaa5eda8c1f045fc61a2df61fc1004f151499b38d6cb04071"} Jul 13 21:10:40.803406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.803378 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" event={"ID":"ef8a4e7c-533a-43cf-b317-2947e7f40bbd","Type":"ContainerStarted","Data":"cb5d0c71ac3492894cfb5e0ddfb54a51702f9e63b4727b57f9f5be4f19cc65b2"} Jul 13 21:10:40.803544 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.803438 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" event={"ID":"ef8a4e7c-533a-43cf-b317-2947e7f40bbd","Type":"ContainerStarted","Data":"31d35f0e562fde0041bfe2565407639e806a508b9a50383d722067edeabc5ee0"} Jul 13 21:10:40.803544 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.803468 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" event={"ID":"ef8a4e7c-533a-43cf-b317-2947e7f40bbd","Type":"ContainerStarted","Data":"9a04dea6d83c5c4b87e8d383e125d13bb175c077cc781800b433ee8024a13229"} Jul 13 21:10:40.841919 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.841875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-web-config\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.841919 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.841925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/480b4617-6143-4d19-9417-5527b951d348-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.842179 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.841982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/480b4617-6143-4d19-9417-5527b951d348-tls-assets\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.842179 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.842005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/480b4617-6143-4d19-9417-5527b951d348-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.842179 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.842036 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-config-volume\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.842179 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.842076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.842179 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.842116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.842179 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.842142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.842179 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.842178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjqt7\" (UniqueName: \"kubernetes.io/projected/480b4617-6143-4d19-9417-5527b951d348-kube-api-access-hjqt7\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.842520 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.842210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.842520 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.842244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/480b4617-6143-4d19-9417-5527b951d348-config-out\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.842520 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.842268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/480b4617-6143-4d19-9417-5527b951d348-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.842520 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.842302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.842772 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.842746 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/480b4617-6143-4d19-9417-5527b951d348-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.843559 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.843265 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/480b4617-6143-4d19-9417-5527b951d348-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.843559 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:10:40.843355 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/480b4617-6143-4d19-9417-5527b951d348-alertmanager-trusted-ca-bundle podName:480b4617-6143-4d19-9417-5527b951d348 nodeName:}" failed. No retries permitted until 2026-07-13 21:10:41.343331707 +0000 UTC m=+80.675996140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/480b4617-6143-4d19-9417-5527b951d348-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "480b4617-6143-4d19-9417-5527b951d348") : configmap references non-existent config key: ca-bundle.crt Jul 13 21:10:40.846743 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.846695 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-config-volume\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.846743 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.846730 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.847637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.847395 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.847742 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.847635 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.848413 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.848388 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-web-config\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.848787 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.848764 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/480b4617-6143-4d19-9417-5527b951d348-config-out\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.848787 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.848779 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.849090 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.849072 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/480b4617-6143-4d19-9417-5527b951d348-tls-assets\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.849161 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.849107 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:40.851195 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:40.851176 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjqt7\" (UniqueName: \"kubernetes.io/projected/480b4617-6143-4d19-9417-5527b951d348-kube-api-access-hjqt7\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:41.346735 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:41.345638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/480b4617-6143-4d19-9417-5527b951d348-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:41.347371 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:41.347344 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/480b4617-6143-4d19-9417-5527b951d348-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:41.446843 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:41.446788 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ad6c5ea-3153-4c62-99de-0391c67b608d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:41.450145 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:41.450118 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ad6c5ea-3153-4c62-99de-0391c67b608d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njg2v\" (UID: \"6ad6c5ea-3153-4c62-99de-0391c67b608d\") " pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:41.459996 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:41.459969 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-njg2v" Jul 13 21:10:41.532142 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:41.532054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:10:41.770551 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:41.770520 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 21:10:41.784345 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:41.784310 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-njg2v"] Jul 13 21:10:41.809497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:41.809465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m8mmg" event={"ID":"3453caf8-27a6-4020-8852-43075d64287d","Type":"ContainerStarted","Data":"393dcb52d8ad4ec7c3b9968a1083d9ce6bb67a4f8d08af9b94d1d107ee1b1a32"} Jul 13 21:10:41.985865 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:10:41.985817 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480b4617_6143_4d19_9417_5527b951d348.slice/crio-4d6ccc55dd330d482435d39ac954c93fd8fe147d2409815735647f28f20c8fe6 WatchSource:0}: Error finding container 4d6ccc55dd330d482435d39ac954c93fd8fe147d2409815735647f28f20c8fe6: Status 404 returned error can't find the container with id 4d6ccc55dd330d482435d39ac954c93fd8fe147d2409815735647f28f20c8fe6 Jul 13 21:10:41.986739 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:10:41.986499 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad6c5ea_3153_4c62_99de_0391c67b608d.slice/crio-974b7ae465dbf880334e7755a364a179957069b3c8b9528004e060a0b48714ab WatchSource:0}: Error finding container 974b7ae465dbf880334e7755a364a179957069b3c8b9528004e060a0b48714ab: Status 404 returned error can't find the container with id 974b7ae465dbf880334e7755a364a179957069b3c8b9528004e060a0b48714ab Jul 13 21:10:42.817544 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:42.817419 2576 generic.go:356] "Generic (PLEG): container finished" podID="3453caf8-27a6-4020-8852-43075d64287d" containerID="393dcb52d8ad4ec7c3b9968a1083d9ce6bb67a4f8d08af9b94d1d107ee1b1a32" exitCode=0 Jul 13 21:10:42.817544 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:42.817524 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m8mmg" event={"ID":"3453caf8-27a6-4020-8852-43075d64287d","Type":"ContainerDied","Data":"393dcb52d8ad4ec7c3b9968a1083d9ce6bb67a4f8d08af9b94d1d107ee1b1a32"} Jul 13 21:10:42.823328 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:42.823295 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" event={"ID":"ef8a4e7c-533a-43cf-b317-2947e7f40bbd","Type":"ContainerStarted","Data":"300e1a2720a2b8b915f97f2c4afbd95f4e6056f0d627957dff734da18e89d2f7"} Jul 13 21:10:42.827434 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:42.827407 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"480b4617-6143-4d19-9417-5527b951d348","Type":"ContainerStarted","Data":"4d6ccc55dd330d482435d39ac954c93fd8fe147d2409815735647f28f20c8fe6"} Jul 13 21:10:42.834331 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:42.834246 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-njg2v" event={"ID":"6ad6c5ea-3153-4c62-99de-0391c67b608d","Type":"ContainerStarted","Data":"974b7ae465dbf880334e7755a364a179957069b3c8b9528004e060a0b48714ab"} Jul 13 21:10:43.769971 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:43.769259 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bb4gv" Jul 13 21:10:43.787075 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:43.787015 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7x8nb" podStartSLOduration=3.530512141 podStartE2EDuration="4.786994499s" totalImagesPullingTime="1.256482358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:42.857316251 +0000 UTC m=+82.189980694" watchObservedRunningTime="2026-07-13 21:10:43.786994499 +0000 UTC m=+83.119658937" Jul 13 21:10:43.841701 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:43.841626 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m8mmg" event={"ID":"3453caf8-27a6-4020-8852-43075d64287d","Type":"ContainerStarted","Data":"f2d732e3fb6add36e1cfb14428cac92c399e3297fcaac311d14975fd0f64eb71"} Jul 13 21:10:43.841701 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:43.841690 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m8mmg" event={"ID":"3453caf8-27a6-4020-8852-43075d64287d","Type":"ContainerStarted","Data":"949b17bf606678692695c7cc0f074fb539f7689b709af7322313396e6b70f237"} Jul 13 21:10:43.844436 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:43.844406 2576 generic.go:356] "Generic (PLEG): container finished" podID="480b4617-6143-4d19-9417-5527b951d348" containerID="13d9ad8449c29344cc4adbff7c5cc9e9360d7ce8059256fb1b46fbf1da3439f1" exitCode=0 Jul 13 21:10:43.844705 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:43.844681 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"480b4617-6143-4d19-9417-5527b951d348","Type":"ContainerDied","Data":"13d9ad8449c29344cc4adbff7c5cc9e9360d7ce8059256fb1b46fbf1da3439f1"} Jul 13 21:10:43.859576 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:43.859521 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m8mmg" podStartSLOduration=3.6297886200000002 podStartE2EDuration="4.859502033s" totalImagesPullingTime="1.145555497s" totalInitContainerRuntime="84.157916ms" isStatefulPod=true podCreationTimestamp="2026-07-13 21:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:10:43.858583208 +0000 UTC m=+83.191247650" watchObservedRunningTime="2026-07-13 21:10:43.859502033 +0000 UTC m=+83.192166475" Jul 13 21:10:44.243772 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.243735 2576 patch_prober.go:28] interesting pod/image-registry-854b6c8876-kvs84 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 13 21:10:44.243970 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.243807 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-854b6c8876-kvs84" podUID="541dafa8-bed7-492e-89e3-483fa362f228" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 21:10:44.752659 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.752620 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d48f55d8f-9pmrd"] Jul 13 21:10:44.768884 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.768826 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d48f55d8f-9pmrd"] Jul 13 21:10:44.769050 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.769005 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.771665 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.771636 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 13 21:10:44.772616 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.771917 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 13 21:10:44.772616 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.772155 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 13 21:10:44.772616 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.772344 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8cjqh\"" Jul 13 21:10:44.772616 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.772450 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 13 21:10:44.772616 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.772543 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 13 21:10:44.778400 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.778266 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 13 21:10:44.877944 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.877905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a45d1ceb-98fa-4536-a681-3c0e88e5de30-telemeter-client-tls\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.878406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.877954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a45d1ceb-98fa-4536-a681-3c0e88e5de30-serving-certs-ca-bundle\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.878406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.877990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a45d1ceb-98fa-4536-a681-3c0e88e5de30-federate-client-tls\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.878406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.878019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lh6t\" (UniqueName: \"kubernetes.io/projected/a45d1ceb-98fa-4536-a681-3c0e88e5de30-kube-api-access-6lh6t\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.878406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.878108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a45d1ceb-98fa-4536-a681-3c0e88e5de30-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.878406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.878162 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a45d1ceb-98fa-4536-a681-3c0e88e5de30-secret-telemeter-client\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.878406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.878245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a45d1ceb-98fa-4536-a681-3c0e88e5de30-metrics-client-ca\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.878406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.878280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a45d1ceb-98fa-4536-a681-3c0e88e5de30-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.979555 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.979070 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a45d1ceb-98fa-4536-a681-3c0e88e5de30-metrics-client-ca\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.979555 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.979141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a45d1ceb-98fa-4536-a681-3c0e88e5de30-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.979555 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.979198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a45d1ceb-98fa-4536-a681-3c0e88e5de30-telemeter-client-tls\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.979555 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.979266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a45d1ceb-98fa-4536-a681-3c0e88e5de30-serving-certs-ca-bundle\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.979555 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.979316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a45d1ceb-98fa-4536-a681-3c0e88e5de30-federate-client-tls\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.979555 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.979348 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lh6t\" (UniqueName: \"kubernetes.io/projected/a45d1ceb-98fa-4536-a681-3c0e88e5de30-kube-api-access-6lh6t\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.979555 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.979398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a45d1ceb-98fa-4536-a681-3c0e88e5de30-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.979555 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.979425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a45d1ceb-98fa-4536-a681-3c0e88e5de30-secret-telemeter-client\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.980083 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.979809 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a45d1ceb-98fa-4536-a681-3c0e88e5de30-metrics-client-ca\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.980731 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.980695 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a45d1ceb-98fa-4536-a681-3c0e88e5de30-serving-certs-ca-bundle\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.981320 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.981287 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a45d1ceb-98fa-4536-a681-3c0e88e5de30-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.982478 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.982447 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a45d1ceb-98fa-4536-a681-3c0e88e5de30-secret-telemeter-client\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.983461 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.983421 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a45d1ceb-98fa-4536-a681-3c0e88e5de30-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.983898 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.983872 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a45d1ceb-98fa-4536-a681-3c0e88e5de30-telemeter-client-tls\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.984214 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.984168 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a45d1ceb-98fa-4536-a681-3c0e88e5de30-federate-client-tls\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:44.987997 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:44.987977 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lh6t\" (UniqueName: \"kubernetes.io/projected/a45d1ceb-98fa-4536-a681-3c0e88e5de30-kube-api-access-6lh6t\") pod \"telemeter-client-d48f55d8f-9pmrd\" (UID: \"a45d1ceb-98fa-4536-a681-3c0e88e5de30\") " pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:45.083894 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.083794 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" Jul 13 21:10:45.709134 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.709033 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-854b6c8876-kvs84" Jul 13 21:10:45.742028 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.741374 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 21:10:45.749968 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.749942 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.756932 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.756902 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 13 21:10:45.756932 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.756920 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 13 21:10:45.757143 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.757114 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 13 21:10:45.757212 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.757147 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 13 21:10:45.757452 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.757434 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 13 21:10:45.757968 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.757625 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 13 21:10:45.757968 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.757781 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 13 21:10:45.758134 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.758030 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 13 21:10:45.758698 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.758363 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 13 21:10:45.758698 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.758612 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5qhl5\"" Jul 13 21:10:45.771750 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.762103 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ah6lhndd9eik1\"" Jul 13 21:10:45.771750 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.763012 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 13 21:10:45.771750 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.763345 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 13 21:10:45.771750 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.763811 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 13 21:10:45.771750 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.769829 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 13 21:10:45.772178 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.772155 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 13 21:10:45.778234 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.778215 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 13 21:10:45.780003 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.779969 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886533 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1b7f3220-f74a-4783-86e2-712784848c7b-config-out\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886608 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-web-config\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-config\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886929 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1b7f3220-f74a-4783-86e2-712784848c7b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.887296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.888355 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.886972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.888355 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.887031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pxsb\" (UniqueName: \"kubernetes.io/projected/1b7f3220-f74a-4783-86e2-712784848c7b-kube-api-access-6pxsb\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.888355 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.887067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.888355 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.887095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988442 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-web-config\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988442 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988172 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988665 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988665 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988665 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-config\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988665 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988665 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988962 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988672 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988962 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988962 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1b7f3220-f74a-4783-86e2-712784848c7b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988962 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988962 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988962 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pxsb\" (UniqueName: \"kubernetes.io/projected/1b7f3220-f74a-4783-86e2-712784848c7b-kube-api-access-6pxsb\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988962 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988885 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988962 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.988962 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1b7f3220-f74a-4783-86e2-712784848c7b-config-out\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.989393 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.988987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.989393 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.989011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.989393 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.989038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.989393 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.989064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.991924 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.990127 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.991924 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.991534 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.991924 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.991869 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.996281 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.996255 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.997008 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.996981 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.997107 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.997045 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.997715 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.997596 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.998426 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.998377 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-config\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.998426 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.998382 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-web-config\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.998426 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.998406 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.998593 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.998448 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.998593 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.998451 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.999790 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.998729 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1b7f3220-f74a-4783-86e2-712784848c7b-config-out\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.999790 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.998789 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.999790 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.999074 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1b7f3220-f74a-4783-86e2-712784848c7b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.999790 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.999397 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:45.999790 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:45.999753 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:46.001323 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:46.001296 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:46.001477 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:46.001444 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:46.001586 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:46.001551 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pxsb\" (UniqueName: \"kubernetes.io/projected/1b7f3220-f74a-4783-86e2-712784848c7b-kube-api-access-6pxsb\") pod \"prometheus-k8s-0\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:46.085276 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:46.085023 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:10:46.878731 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:46.878676 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 21:10:46.892444 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:46.892415 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d48f55d8f-9pmrd"] Jul 13 21:10:47.140531 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:10:47.140501 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b7f3220_f74a_4783_86e2_712784848c7b.slice/crio-a2bfafdfd68c17e5595130e344e8d44fbd02ec18f1acf2c3cb27a83823b144f6 WatchSource:0}: Error finding container a2bfafdfd68c17e5595130e344e8d44fbd02ec18f1acf2c3cb27a83823b144f6: Status 404 returned error can't find the container with id a2bfafdfd68c17e5595130e344e8d44fbd02ec18f1acf2c3cb27a83823b144f6 Jul 13 21:10:47.141285 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:10:47.141263 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda45d1ceb_98fa_4536_a681_3c0e88e5de30.slice/crio-94c2f022b5e372fb97f399a95b8624add17063dd9e0c9d4534800a5999ea6242 WatchSource:0}: Error finding container 94c2f022b5e372fb97f399a95b8624add17063dd9e0c9d4534800a5999ea6242: Status 404 returned error can't find the container with id 94c2f022b5e372fb97f399a95b8624add17063dd9e0c9d4534800a5999ea6242 Jul 13 21:10:47.870641 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:47.870606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"480b4617-6143-4d19-9417-5527b951d348","Type":"ContainerStarted","Data":"1533e1ea11111b374cc4c7629f54735545d01652b3de0450ceaeeb3fd664474d"} Jul 13 21:10:47.870808 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:47.870703 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"480b4617-6143-4d19-9417-5527b951d348","Type":"ContainerStarted","Data":"15f69398b7910a56a5ecb408fb8c6c4b2ff04c4af1c5980cad9ce8add790fcc6"} Jul 13 21:10:47.870808 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:47.870739 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"480b4617-6143-4d19-9417-5527b951d348","Type":"ContainerStarted","Data":"f05b3ebf9d13095298f4ae6355b853829acf9ad197e5b5d7fcde090120194a69"} Jul 13 21:10:47.870808 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:47.870763 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"480b4617-6143-4d19-9417-5527b951d348","Type":"ContainerStarted","Data":"47bfc9548cb3ae16bef3c792510f8701a27639747e4a1fa4908bc362611ca1f7"} Jul 13 21:10:47.870808 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:47.870785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"480b4617-6143-4d19-9417-5527b951d348","Type":"ContainerStarted","Data":"b103bc8c1e74dd6679bf09fe04f844fcfd464f0ef4bd69dc05e597b2f94312b4"} Jul 13 21:10:47.872057 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:47.872030 2576 generic.go:356] "Generic (PLEG): container finished" podID="1b7f3220-f74a-4783-86e2-712784848c7b" containerID="ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877" exitCode=0 Jul 13 21:10:47.872150 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:47.872115 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b7f3220-f74a-4783-86e2-712784848c7b","Type":"ContainerDied","Data":"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877"} Jul 13 21:10:47.872211 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:47.872195 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b7f3220-f74a-4783-86e2-712784848c7b","Type":"ContainerStarted","Data":"a2bfafdfd68c17e5595130e344e8d44fbd02ec18f1acf2c3cb27a83823b144f6"} Jul 13 21:10:47.873684 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:47.873646 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-njg2v" event={"ID":"6ad6c5ea-3153-4c62-99de-0391c67b608d","Type":"ContainerStarted","Data":"c2afd1d15c77287b718e980ea1e936bef436a27567902d372d833ea8eaf9d77b"} Jul 13 21:10:47.874778 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:47.874757 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" event={"ID":"a45d1ceb-98fa-4536-a681-3c0e88e5de30","Type":"ContainerStarted","Data":"94c2f022b5e372fb97f399a95b8624add17063dd9e0c9d4534800a5999ea6242"} Jul 13 21:10:48.885141 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:10:48.885052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-njg2v" event={"ID":"6ad6c5ea-3153-4c62-99de-0391c67b608d","Type":"ContainerStarted","Data":"8e345922bfb58e818a932ae0e1c3f9784473ee04703bee0ef728ebc6a49992b3"} Jul 13 21:11:00.941269 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:00.941225 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-gqh8x" event={"ID":"d4a72567-3385-4112-9960-850384d34c8b","Type":"ContainerStarted","Data":"4bb42efb67cce141380f058573a6a1258503eea43ae127743164965c0a59b4fd"} Jul 13 21:11:00.941788 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:00.941407 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-gqh8x" Jul 13 21:11:00.944509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:00.944477 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" event={"ID":"a45d1ceb-98fa-4536-a681-3c0e88e5de30","Type":"ContainerStarted","Data":"49197bd50333a53bf2d9f9c9287756361d8eacb1175f477da7e7dc121720cd9b"} Jul 13 21:11:00.944646 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:00.944532 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" event={"ID":"a45d1ceb-98fa-4536-a681-3c0e88e5de30","Type":"ContainerStarted","Data":"25b6cae0754bfa01b1a701da3b595505d05fc255bef7db84d22b59b33dd2c0d0"} Jul 13 21:11:00.944646 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:00.944559 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" event={"ID":"a45d1ceb-98fa-4536-a681-3c0e88e5de30","Type":"ContainerStarted","Data":"7b3bd17c934e26e00f9f3c46fa5bb8f6a60e2ce27f3d3a26d3677219340b9c59"} Jul 13 21:11:00.948537 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:00.948501 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"480b4617-6143-4d19-9417-5527b951d348","Type":"ContainerStarted","Data":"0ff767d9a27c3ffd26db0f43900e0406520a5678e02cbd4b241c9eeecd8dae29"} Jul 13 21:11:00.951134 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:00.951106 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b7f3220-f74a-4783-86e2-712784848c7b","Type":"ContainerStarted","Data":"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1"} Jul 13 21:11:00.951263 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:00.951193 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b7f3220-f74a-4783-86e2-712784848c7b","Type":"ContainerStarted","Data":"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d"} Jul 13 21:11:00.953461 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:00.953434 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-njg2v" event={"ID":"6ad6c5ea-3153-4c62-99de-0391c67b608d","Type":"ContainerStarted","Data":"fcb5442d3ec2f20af1df93829e572f9a85b5e626866483d0835a5c9d8f5f398b"} Jul 13 21:11:00.956598 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:00.956576 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-gqh8x" Jul 13 21:11:00.962277 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:00.962214 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-gqh8x" podStartSLOduration=1.4515244809999999 podStartE2EDuration="27.962196641s" totalImagesPullingTime="26.51067216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:00.959563646 +0000 UTC m=+100.292228087" watchObservedRunningTime="2026-07-13 21:11:00.962196641 +0000 UTC m=+100.294861081" Jul 13 21:11:00.989725 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:00.989655 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.4417290400000002 podStartE2EDuration="20.989633627s" totalImagesPullingTime="17.528368775s" totalInitContainerRuntime="19.535812ms" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:00.987838229 +0000 UTC m=+100.320502671" watchObservedRunningTime="2026-07-13 21:11:00.989633627 +0000 UTC m=+100.322298068" Jul 13 21:11:01.038011 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:01.037954 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-njg2v" podStartSLOduration=10.078064557 podStartE2EDuration="28.037932963s" totalImagesPullingTime="17.959868406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:10:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:01.037111131 +0000 UTC m=+100.369775573" watchObservedRunningTime="2026-07-13 21:11:01.037932963 +0000 UTC m=+100.370597405" Jul 13 21:11:01.040229 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:01.040180 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d48f55d8f-9pmrd" podStartSLOduration=4.078748729 podStartE2EDuration="17.040163624s" totalImagesPullingTime="12.961414895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:01.011688 +0000 UTC m=+100.344352465" watchObservedRunningTime="2026-07-13 21:11:01.040163624 +0000 UTC m=+100.372828068" Jul 13 21:11:03.975018 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:03.974982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b7f3220-f74a-4783-86e2-712784848c7b","Type":"ContainerStarted","Data":"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db"} Jul 13 21:11:03.975540 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:03.975092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b7f3220-f74a-4783-86e2-712784848c7b","Type":"ContainerStarted","Data":"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413"} Jul 13 21:11:03.975540 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:03.975137 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b7f3220-f74a-4783-86e2-712784848c7b","Type":"ContainerStarted","Data":"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106"} Jul 13 21:11:03.975540 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:03.975181 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b7f3220-f74a-4783-86e2-712784848c7b","Type":"ContainerStarted","Data":"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f"} Jul 13 21:11:04.001805 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:04.001609 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.847827572 podStartE2EDuration="19.001586103s" totalImagesPullingTime="15.128981512s" totalInitContainerRuntime="24.777019ms" isStatefulPod=false podCreationTimestamp="2026-07-13 21:10:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:04.000561168 +0000 UTC m=+103.333225665" watchObservedRunningTime="2026-07-13 21:11:04.001586103 +0000 UTC m=+103.334250548" Jul 13 21:11:04.769106 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:04.769054 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-82gqz" Jul 13 21:11:06.085684 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:06.085647 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:11:46.086267 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:46.086226 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:11:46.147230 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:46.147203 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:11:46.164851 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:46.164827 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:11:59.870472 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:59.870435 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 21:11:59.871259 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:59.870724 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="alertmanager" containerID="cri-o://b103bc8c1e74dd6679bf09fe04f844fcfd464f0ef4bd69dc05e597b2f94312b4" gracePeriod=120 Jul 13 21:11:59.871259 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:59.870787 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="kube-rbac-proxy-metric" containerID="cri-o://1533e1ea11111b374cc4c7629f54735545d01652b3de0450ceaeeb3fd664474d" gracePeriod=120 Jul 13 21:11:59.871259 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:59.870808 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="prom-label-proxy" containerID="cri-o://0ff767d9a27c3ffd26db0f43900e0406520a5678e02cbd4b241c9eeecd8dae29" gracePeriod=120 Jul 13 21:11:59.871259 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:59.870843 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="kube-rbac-proxy-web" containerID="cri-o://f05b3ebf9d13095298f4ae6355b853829acf9ad197e5b5d7fcde090120194a69" gracePeriod=120 Jul 13 21:11:59.871259 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:59.870904 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="kube-rbac-proxy" containerID="cri-o://15f69398b7910a56a5ecb408fb8c6c4b2ff04c4af1c5980cad9ce8add790fcc6" gracePeriod=120 Jul 13 21:11:59.871259 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:11:59.870895 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="config-reloader" containerID="cri-o://47bfc9548cb3ae16bef3c792510f8701a27639747e4a1fa4908bc362611ca1f7" gracePeriod=120 Jul 13 21:12:00.206761 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:00.206732 2576 generic.go:356] "Generic (PLEG): container finished" podID="480b4617-6143-4d19-9417-5527b951d348" containerID="0ff767d9a27c3ffd26db0f43900e0406520a5678e02cbd4b241c9eeecd8dae29" exitCode=0 Jul 13 21:12:00.206761 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:00.206758 2576 generic.go:356] "Generic (PLEG): container finished" podID="480b4617-6143-4d19-9417-5527b951d348" containerID="1533e1ea11111b374cc4c7629f54735545d01652b3de0450ceaeeb3fd664474d" exitCode=0 Jul 13 21:12:00.206761 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:00.206765 2576 generic.go:356] "Generic (PLEG): container finished" podID="480b4617-6143-4d19-9417-5527b951d348" containerID="15f69398b7910a56a5ecb408fb8c6c4b2ff04c4af1c5980cad9ce8add790fcc6" exitCode=0 Jul 13 21:12:00.206996 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:00.206772 2576 generic.go:356] "Generic (PLEG): container finished" podID="480b4617-6143-4d19-9417-5527b951d348" containerID="47bfc9548cb3ae16bef3c792510f8701a27639747e4a1fa4908bc362611ca1f7" exitCode=0 Jul 13 21:12:00.206996 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:00.206782 2576 generic.go:356] "Generic (PLEG): container finished" podID="480b4617-6143-4d19-9417-5527b951d348" containerID="b103bc8c1e74dd6679bf09fe04f844fcfd464f0ef4bd69dc05e597b2f94312b4" exitCode=0 Jul 13 21:12:00.206996 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:00.206802 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"480b4617-6143-4d19-9417-5527b951d348","Type":"ContainerDied","Data":"0ff767d9a27c3ffd26db0f43900e0406520a5678e02cbd4b241c9eeecd8dae29"} Jul 13 21:12:00.206996 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:00.206944 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"480b4617-6143-4d19-9417-5527b951d348","Type":"ContainerDied","Data":"1533e1ea11111b374cc4c7629f54735545d01652b3de0450ceaeeb3fd664474d"} Jul 13 21:12:00.206996 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:00.206983 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"480b4617-6143-4d19-9417-5527b951d348","Type":"ContainerDied","Data":"15f69398b7910a56a5ecb408fb8c6c4b2ff04c4af1c5980cad9ce8add790fcc6"} Jul 13 21:12:00.207143 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:00.207008 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"480b4617-6143-4d19-9417-5527b951d348","Type":"ContainerDied","Data":"47bfc9548cb3ae16bef3c792510f8701a27639747e4a1fa4908bc362611ca1f7"} Jul 13 21:12:00.207143 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:00.207031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"480b4617-6143-4d19-9417-5527b951d348","Type":"ContainerDied","Data":"b103bc8c1e74dd6679bf09fe04f844fcfd464f0ef4bd69dc05e597b2f94312b4"} Jul 13 21:12:01.119527 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.119499 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:12:01.188264 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.188236 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/480b4617-6143-4d19-9417-5527b951d348-tls-assets\") pod \"480b4617-6143-4d19-9417-5527b951d348\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " Jul 13 21:12:01.188450 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.188275 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-main-tls\") pod \"480b4617-6143-4d19-9417-5527b951d348\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " Jul 13 21:12:01.188450 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.188305 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy-web\") pod \"480b4617-6143-4d19-9417-5527b951d348\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " Jul 13 21:12:01.188450 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.188341 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/480b4617-6143-4d19-9417-5527b951d348-config-out\") pod \"480b4617-6143-4d19-9417-5527b951d348\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " Jul 13 21:12:01.188450 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.188366 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/480b4617-6143-4d19-9417-5527b951d348-alertmanager-trusted-ca-bundle\") pod \"480b4617-6143-4d19-9417-5527b951d348\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " Jul 13 21:12:01.188450 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.188418 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy-metric\") pod \"480b4617-6143-4d19-9417-5527b951d348\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " Jul 13 21:12:01.188775 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.188465 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/480b4617-6143-4d19-9417-5527b951d348-alertmanager-main-db\") pod \"480b4617-6143-4d19-9417-5527b951d348\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " Jul 13 21:12:01.188961 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.188940 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-config-volume\") pod \"480b4617-6143-4d19-9417-5527b951d348\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " Jul 13 21:12:01.189048 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.188958 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/480b4617-6143-4d19-9417-5527b951d348-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "480b4617-6143-4d19-9417-5527b951d348" (UID: "480b4617-6143-4d19-9417-5527b951d348"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:12:01.189048 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.188970 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/480b4617-6143-4d19-9417-5527b951d348-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "480b4617-6143-4d19-9417-5527b951d348" (UID: "480b4617-6143-4d19-9417-5527b951d348"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:12:01.189048 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.188996 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjqt7\" (UniqueName: \"kubernetes.io/projected/480b4617-6143-4d19-9417-5527b951d348-kube-api-access-hjqt7\") pod \"480b4617-6143-4d19-9417-5527b951d348\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " Jul 13 21:12:01.189048 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.189023 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy\") pod \"480b4617-6143-4d19-9417-5527b951d348\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " Jul 13 21:12:01.189267 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.189071 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-web-config\") pod \"480b4617-6143-4d19-9417-5527b951d348\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " Jul 13 21:12:01.189267 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.189128 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/480b4617-6143-4d19-9417-5527b951d348-metrics-client-ca\") pod \"480b4617-6143-4d19-9417-5527b951d348\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " Jul 13 21:12:01.189267 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.189154 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-cluster-tls-config\") pod \"480b4617-6143-4d19-9417-5527b951d348\" (UID: \"480b4617-6143-4d19-9417-5527b951d348\") " Jul 13 21:12:01.189642 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.189466 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/480b4617-6143-4d19-9417-5527b951d348-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:01.189642 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.189490 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/480b4617-6143-4d19-9417-5527b951d348-alertmanager-main-db\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:01.190150 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.190122 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/480b4617-6143-4d19-9417-5527b951d348-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "480b4617-6143-4d19-9417-5527b951d348" (UID: "480b4617-6143-4d19-9417-5527b951d348"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:12:01.191452 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.191428 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "480b4617-6143-4d19-9417-5527b951d348" (UID: "480b4617-6143-4d19-9417-5527b951d348"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:01.191683 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.191642 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/480b4617-6143-4d19-9417-5527b951d348-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "480b4617-6143-4d19-9417-5527b951d348" (UID: "480b4617-6143-4d19-9417-5527b951d348"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:12:01.192486 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.192351 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "480b4617-6143-4d19-9417-5527b951d348" (UID: "480b4617-6143-4d19-9417-5527b951d348"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:01.192486 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.192447 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "480b4617-6143-4d19-9417-5527b951d348" (UID: "480b4617-6143-4d19-9417-5527b951d348"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:01.192998 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.192967 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "480b4617-6143-4d19-9417-5527b951d348" (UID: "480b4617-6143-4d19-9417-5527b951d348"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:01.193098 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.192977 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-config-volume" (OuterVolumeSpecName: "config-volume") pod "480b4617-6143-4d19-9417-5527b951d348" (UID: "480b4617-6143-4d19-9417-5527b951d348"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:01.193349 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.193329 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/480b4617-6143-4d19-9417-5527b951d348-kube-api-access-hjqt7" (OuterVolumeSpecName: "kube-api-access-hjqt7") pod "480b4617-6143-4d19-9417-5527b951d348" (UID: "480b4617-6143-4d19-9417-5527b951d348"). InnerVolumeSpecName "kube-api-access-hjqt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:12:01.194148 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.194121 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/480b4617-6143-4d19-9417-5527b951d348-config-out" (OuterVolumeSpecName: "config-out") pod "480b4617-6143-4d19-9417-5527b951d348" (UID: "480b4617-6143-4d19-9417-5527b951d348"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:12:01.197326 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.197221 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "480b4617-6143-4d19-9417-5527b951d348" (UID: "480b4617-6143-4d19-9417-5527b951d348"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:01.204086 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.204060 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-web-config" (OuterVolumeSpecName: "web-config") pod "480b4617-6143-4d19-9417-5527b951d348" (UID: "480b4617-6143-4d19-9417-5527b951d348"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:01.213748 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.213687 2576 generic.go:356] "Generic (PLEG): container finished" podID="480b4617-6143-4d19-9417-5527b951d348" containerID="f05b3ebf9d13095298f4ae6355b853829acf9ad197e5b5d7fcde090120194a69" exitCode=0 Jul 13 21:12:01.213840 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.213763 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 21:12:01.213840 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.213765 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"480b4617-6143-4d19-9417-5527b951d348","Type":"ContainerDied","Data":"f05b3ebf9d13095298f4ae6355b853829acf9ad197e5b5d7fcde090120194a69"} Jul 13 21:12:01.213840 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.213833 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"480b4617-6143-4d19-9417-5527b951d348","Type":"ContainerDied","Data":"4d6ccc55dd330d482435d39ac954c93fd8fe147d2409815735647f28f20c8fe6"} Jul 13 21:12:01.214011 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.213887 2576 scope.go:117] "RemoveContainer" containerID="0ff767d9a27c3ffd26db0f43900e0406520a5678e02cbd4b241c9eeecd8dae29" Jul 13 21:12:01.222977 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.222958 2576 scope.go:117] "RemoveContainer" containerID="1533e1ea11111b374cc4c7629f54735545d01652b3de0450ceaeeb3fd664474d" Jul 13 21:12:01.230343 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.230319 2576 scope.go:117] "RemoveContainer" containerID="15f69398b7910a56a5ecb408fb8c6c4b2ff04c4af1c5980cad9ce8add790fcc6" Jul 13 21:12:01.238685 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.238668 2576 scope.go:117] "RemoveContainer" containerID="f05b3ebf9d13095298f4ae6355b853829acf9ad197e5b5d7fcde090120194a69" Jul 13 21:12:01.246072 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.246046 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 21:12:01.247364 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.247350 2576 scope.go:117] "RemoveContainer" containerID="47bfc9548cb3ae16bef3c792510f8701a27639747e4a1fa4908bc362611ca1f7" Jul 13 21:12:01.254519 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.254494 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 21:12:01.257867 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.257829 2576 scope.go:117] "RemoveContainer" containerID="b103bc8c1e74dd6679bf09fe04f844fcfd464f0ef4bd69dc05e597b2f94312b4" Jul 13 21:12:01.265747 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.265726 2576 scope.go:117] "RemoveContainer" containerID="13d9ad8449c29344cc4adbff7c5cc9e9360d7ce8059256fb1b46fbf1da3439f1" Jul 13 21:12:01.272731 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.272704 2576 scope.go:117] "RemoveContainer" containerID="0ff767d9a27c3ffd26db0f43900e0406520a5678e02cbd4b241c9eeecd8dae29" Jul 13 21:12:01.272997 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:12:01.272978 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ff767d9a27c3ffd26db0f43900e0406520a5678e02cbd4b241c9eeecd8dae29\": container with ID starting with 0ff767d9a27c3ffd26db0f43900e0406520a5678e02cbd4b241c9eeecd8dae29 not found: ID does not exist" containerID="0ff767d9a27c3ffd26db0f43900e0406520a5678e02cbd4b241c9eeecd8dae29" Jul 13 21:12:01.273054 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.273007 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ff767d9a27c3ffd26db0f43900e0406520a5678e02cbd4b241c9eeecd8dae29"} err="failed to get container status \"0ff767d9a27c3ffd26db0f43900e0406520a5678e02cbd4b241c9eeecd8dae29\": rpc error: code = NotFound desc = could not find container \"0ff767d9a27c3ffd26db0f43900e0406520a5678e02cbd4b241c9eeecd8dae29\": container with ID starting with 0ff767d9a27c3ffd26db0f43900e0406520a5678e02cbd4b241c9eeecd8dae29 not found: ID does not exist" Jul 13 21:12:01.273054 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.273039 2576 scope.go:117] "RemoveContainer" containerID="1533e1ea11111b374cc4c7629f54735545d01652b3de0450ceaeeb3fd664474d" Jul 13 21:12:01.273279 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:12:01.273260 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1533e1ea11111b374cc4c7629f54735545d01652b3de0450ceaeeb3fd664474d\": container with ID starting with 1533e1ea11111b374cc4c7629f54735545d01652b3de0450ceaeeb3fd664474d not found: ID does not exist" containerID="1533e1ea11111b374cc4c7629f54735545d01652b3de0450ceaeeb3fd664474d" Jul 13 21:12:01.273327 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.273285 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1533e1ea11111b374cc4c7629f54735545d01652b3de0450ceaeeb3fd664474d"} err="failed to get container status \"1533e1ea11111b374cc4c7629f54735545d01652b3de0450ceaeeb3fd664474d\": rpc error: code = NotFound desc = could not find container \"1533e1ea11111b374cc4c7629f54735545d01652b3de0450ceaeeb3fd664474d\": container with ID starting with 1533e1ea11111b374cc4c7629f54735545d01652b3de0450ceaeeb3fd664474d not found: ID does not exist" Jul 13 21:12:01.273327 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.273303 2576 scope.go:117] "RemoveContainer" containerID="15f69398b7910a56a5ecb408fb8c6c4b2ff04c4af1c5980cad9ce8add790fcc6" Jul 13 21:12:01.273544 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:12:01.273519 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15f69398b7910a56a5ecb408fb8c6c4b2ff04c4af1c5980cad9ce8add790fcc6\": container with ID starting with 15f69398b7910a56a5ecb408fb8c6c4b2ff04c4af1c5980cad9ce8add790fcc6 not found: ID does not exist" containerID="15f69398b7910a56a5ecb408fb8c6c4b2ff04c4af1c5980cad9ce8add790fcc6" Jul 13 21:12:01.273600 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.273552 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f69398b7910a56a5ecb408fb8c6c4b2ff04c4af1c5980cad9ce8add790fcc6"} err="failed to get container status \"15f69398b7910a56a5ecb408fb8c6c4b2ff04c4af1c5980cad9ce8add790fcc6\": rpc error: code = NotFound desc = could not find container \"15f69398b7910a56a5ecb408fb8c6c4b2ff04c4af1c5980cad9ce8add790fcc6\": container with ID starting with 15f69398b7910a56a5ecb408fb8c6c4b2ff04c4af1c5980cad9ce8add790fcc6 not found: ID does not exist" Jul 13 21:12:01.273600 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.273577 2576 scope.go:117] "RemoveContainer" containerID="f05b3ebf9d13095298f4ae6355b853829acf9ad197e5b5d7fcde090120194a69" Jul 13 21:12:01.273837 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:12:01.273817 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f05b3ebf9d13095298f4ae6355b853829acf9ad197e5b5d7fcde090120194a69\": container with ID starting with f05b3ebf9d13095298f4ae6355b853829acf9ad197e5b5d7fcde090120194a69 not found: ID does not exist" containerID="f05b3ebf9d13095298f4ae6355b853829acf9ad197e5b5d7fcde090120194a69" Jul 13 21:12:01.273974 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.273841 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f05b3ebf9d13095298f4ae6355b853829acf9ad197e5b5d7fcde090120194a69"} err="failed to get container status \"f05b3ebf9d13095298f4ae6355b853829acf9ad197e5b5d7fcde090120194a69\": rpc error: code = NotFound desc = could not find container \"f05b3ebf9d13095298f4ae6355b853829acf9ad197e5b5d7fcde090120194a69\": container with ID starting with f05b3ebf9d13095298f4ae6355b853829acf9ad197e5b5d7fcde090120194a69 not found: ID does not exist" Jul 13 21:12:01.273974 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.273913 2576 scope.go:117] "RemoveContainer" containerID="47bfc9548cb3ae16bef3c792510f8701a27639747e4a1fa4908bc362611ca1f7" Jul 13 21:12:01.274186 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:12:01.274164 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47bfc9548cb3ae16bef3c792510f8701a27639747e4a1fa4908bc362611ca1f7\": container with ID starting with 47bfc9548cb3ae16bef3c792510f8701a27639747e4a1fa4908bc362611ca1f7 not found: ID does not exist" containerID="47bfc9548cb3ae16bef3c792510f8701a27639747e4a1fa4908bc362611ca1f7" Jul 13 21:12:01.274235 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.274193 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47bfc9548cb3ae16bef3c792510f8701a27639747e4a1fa4908bc362611ca1f7"} err="failed to get container status \"47bfc9548cb3ae16bef3c792510f8701a27639747e4a1fa4908bc362611ca1f7\": rpc error: code = NotFound desc = could not find container \"47bfc9548cb3ae16bef3c792510f8701a27639747e4a1fa4908bc362611ca1f7\": container with ID starting with 47bfc9548cb3ae16bef3c792510f8701a27639747e4a1fa4908bc362611ca1f7 not found: ID does not exist" Jul 13 21:12:01.274235 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.274213 2576 scope.go:117] "RemoveContainer" containerID="b103bc8c1e74dd6679bf09fe04f844fcfd464f0ef4bd69dc05e597b2f94312b4" Jul 13 21:12:01.274469 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:12:01.274453 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b103bc8c1e74dd6679bf09fe04f844fcfd464f0ef4bd69dc05e597b2f94312b4\": container with ID starting with b103bc8c1e74dd6679bf09fe04f844fcfd464f0ef4bd69dc05e597b2f94312b4 not found: ID does not exist" containerID="b103bc8c1e74dd6679bf09fe04f844fcfd464f0ef4bd69dc05e597b2f94312b4" Jul 13 21:12:01.274523 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.274472 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b103bc8c1e74dd6679bf09fe04f844fcfd464f0ef4bd69dc05e597b2f94312b4"} err="failed to get container status \"b103bc8c1e74dd6679bf09fe04f844fcfd464f0ef4bd69dc05e597b2f94312b4\": rpc error: code = NotFound desc = could not find container \"b103bc8c1e74dd6679bf09fe04f844fcfd464f0ef4bd69dc05e597b2f94312b4\": container with ID starting with b103bc8c1e74dd6679bf09fe04f844fcfd464f0ef4bd69dc05e597b2f94312b4 not found: ID does not exist" Jul 13 21:12:01.274523 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.274485 2576 scope.go:117] "RemoveContainer" containerID="13d9ad8449c29344cc4adbff7c5cc9e9360d7ce8059256fb1b46fbf1da3439f1" Jul 13 21:12:01.274722 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:12:01.274706 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13d9ad8449c29344cc4adbff7c5cc9e9360d7ce8059256fb1b46fbf1da3439f1\": container with ID starting with 13d9ad8449c29344cc4adbff7c5cc9e9360d7ce8059256fb1b46fbf1da3439f1 not found: ID does not exist" containerID="13d9ad8449c29344cc4adbff7c5cc9e9360d7ce8059256fb1b46fbf1da3439f1" Jul 13 21:12:01.274764 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.274726 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13d9ad8449c29344cc4adbff7c5cc9e9360d7ce8059256fb1b46fbf1da3439f1"} err="failed to get container status \"13d9ad8449c29344cc4adbff7c5cc9e9360d7ce8059256fb1b46fbf1da3439f1\": rpc error: code = NotFound desc = could not find container \"13d9ad8449c29344cc4adbff7c5cc9e9360d7ce8059256fb1b46fbf1da3439f1\": container with ID starting with 13d9ad8449c29344cc4adbff7c5cc9e9360d7ce8059256fb1b46fbf1da3439f1 not found: ID does not exist" Jul 13 21:12:01.278944 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.278920 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="480b4617-6143-4d19-9417-5527b951d348" path="/var/lib/kubelet/pods/480b4617-6143-4d19-9417-5527b951d348/volumes" Jul 13 21:12:01.290279 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.290255 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:01.290369 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.290281 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-config-volume\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:01.290369 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.290294 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjqt7\" (UniqueName: \"kubernetes.io/projected/480b4617-6143-4d19-9417-5527b951d348-kube-api-access-hjqt7\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:01.290369 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.290303 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:01.290369 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.290334 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-web-config\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:01.290369 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.290347 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/480b4617-6143-4d19-9417-5527b951d348-metrics-client-ca\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:01.290369 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.290356 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-cluster-tls-config\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:01.290369 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.290364 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/480b4617-6143-4d19-9417-5527b951d348-tls-assets\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:01.290574 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.290372 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-main-tls\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:01.290574 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.290381 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/480b4617-6143-4d19-9417-5527b951d348-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:01.290574 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:01.290389 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/480b4617-6143-4d19-9417-5527b951d348-config-out\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.121056 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.121011 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 21:12:04.121536 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.121395 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="prometheus" containerID="cri-o://b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d" gracePeriod=600 Jul 13 21:12:04.121776 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.121750 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="kube-rbac-proxy-web" containerID="cri-o://0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106" gracePeriod=600 Jul 13 21:12:04.121895 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.121799 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db" gracePeriod=600 Jul 13 21:12:04.121984 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.121895 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="thanos-sidecar" containerID="cri-o://7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f" gracePeriod=600 Jul 13 21:12:04.121984 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.121746 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="kube-rbac-proxy" containerID="cri-o://6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413" gracePeriod=600 Jul 13 21:12:04.122127 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.122045 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="config-reloader" containerID="cri-o://243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1" gracePeriod=600 Jul 13 21:12:04.374893 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.374821 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:04.418273 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418241 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-1\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.418273 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418279 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1b7f3220-f74a-4783-86e2-712784848c7b-tls-assets\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.418516 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418304 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-config\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.418516 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418331 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-kubelet-serving-ca-bundle\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.418516 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418445 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-0\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.418516 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418491 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pxsb\" (UniqueName: \"kubernetes.io/projected/1b7f3220-f74a-4783-86e2-712784848c7b-kube-api-access-6pxsb\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.418799 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418528 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-serving-certs-ca-bundle\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.418799 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418575 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.418799 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418591 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:12:04.418799 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418610 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1b7f3220-f74a-4783-86e2-712784848c7b-config-out\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.418799 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418634 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-trusted-ca-bundle\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.418799 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418657 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:12:04.418799 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418666 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-2\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.418799 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418717 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.418799 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418747 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-grpc-tls\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.418799 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418799 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-thanos-prometheus-http-client-file\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.419320 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418828 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-web-config\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.419320 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418874 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-tls\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.419320 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418850 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:12:04.419320 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418903 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:12:04.419320 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418909 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-kube-rbac-proxy\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.419320 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418940 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-db\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.419320 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.418971 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-metrics-client-ca\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.419320 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.419017 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-metrics-client-certs\") pod \"1b7f3220-f74a-4783-86e2-712784848c7b\" (UID: \"1b7f3220-f74a-4783-86e2-712784848c7b\") " Jul 13 21:12:04.419320 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.419246 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.419320 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.419262 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.419320 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.419277 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.419320 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.419292 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.419912 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.419531 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:12:04.421750 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.421162 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:12:04.421750 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.421484 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:12:04.421986 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.421771 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b7f3220-f74a-4783-86e2-712784848c7b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:12:04.422295 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.422258 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:12:04.424537 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.424510 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:04.427584 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.427480 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:04.427584 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.427522 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:04.427584 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.427532 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:04.427584 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.427547 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-config" (OuterVolumeSpecName: "config") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:04.427840 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.427587 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:04.427840 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.427599 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b7f3220-f74a-4783-86e2-712784848c7b-kube-api-access-6pxsb" (OuterVolumeSpecName: "kube-api-access-6pxsb") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "kube-api-access-6pxsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:12:04.427840 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.427655 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:04.427840 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.427774 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:04.427840 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.427826 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b7f3220-f74a-4783-86e2-712784848c7b-config-out" (OuterVolumeSpecName: "config-out") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:12:04.441259 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.441219 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-web-config" (OuterVolumeSpecName: "web-config") pod "1b7f3220-f74a-4783-86e2-712784848c7b" (UID: "1b7f3220-f74a-4783-86e2-712784848c7b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:12:04.520468 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520432 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.520662 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520512 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1b7f3220-f74a-4783-86e2-712784848c7b-config-out\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.520662 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520534 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.520662 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520548 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.520662 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520560 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-grpc-tls\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.520662 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520572 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.520662 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520583 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-web-config\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.520662 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520595 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.520662 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520607 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-kube-rbac-proxy\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.520662 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520619 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-db\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.520662 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520630 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-configmap-metrics-client-ca\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.520662 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520642 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-secret-metrics-client-certs\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.520662 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520653 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1b7f3220-f74a-4783-86e2-712784848c7b-tls-assets\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.521256 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520671 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b7f3220-f74a-4783-86e2-712784848c7b-config\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.521256 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520684 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1b7f3220-f74a-4783-86e2-712784848c7b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:04.521256 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:04.520699 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pxsb\" (UniqueName: \"kubernetes.io/projected/1b7f3220-f74a-4783-86e2-712784848c7b-kube-api-access-6pxsb\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:12:05.240750 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.240716 2576 generic.go:356] "Generic (PLEG): container finished" podID="1b7f3220-f74a-4783-86e2-712784848c7b" containerID="add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db" exitCode=0 Jul 13 21:12:05.240750 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.240742 2576 generic.go:356] "Generic (PLEG): container finished" podID="1b7f3220-f74a-4783-86e2-712784848c7b" containerID="6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413" exitCode=0 Jul 13 21:12:05.240750 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.240752 2576 generic.go:356] "Generic (PLEG): container finished" podID="1b7f3220-f74a-4783-86e2-712784848c7b" containerID="0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106" exitCode=0 Jul 13 21:12:05.241392 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.240761 2576 generic.go:356] "Generic (PLEG): container finished" podID="1b7f3220-f74a-4783-86e2-712784848c7b" containerID="7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f" exitCode=0 Jul 13 21:12:05.241392 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.240770 2576 generic.go:356] "Generic (PLEG): container finished" podID="1b7f3220-f74a-4783-86e2-712784848c7b" containerID="243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1" exitCode=0 Jul 13 21:12:05.241392 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.240777 2576 generic.go:356] "Generic (PLEG): container finished" podID="1b7f3220-f74a-4783-86e2-712784848c7b" containerID="b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d" exitCode=0 Jul 13 21:12:05.241392 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.240791 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b7f3220-f74a-4783-86e2-712784848c7b","Type":"ContainerDied","Data":"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db"} Jul 13 21:12:05.241392 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.240811 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.241392 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.240875 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b7f3220-f74a-4783-86e2-712784848c7b","Type":"ContainerDied","Data":"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413"} Jul 13 21:12:05.241392 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.240905 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b7f3220-f74a-4783-86e2-712784848c7b","Type":"ContainerDied","Data":"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106"} Jul 13 21:12:05.241392 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.240929 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b7f3220-f74a-4783-86e2-712784848c7b","Type":"ContainerDied","Data":"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f"} Jul 13 21:12:05.241392 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.240944 2576 scope.go:117] "RemoveContainer" containerID="add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db" Jul 13 21:12:05.241392 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.240952 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b7f3220-f74a-4783-86e2-712784848c7b","Type":"ContainerDied","Data":"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1"} Jul 13 21:12:05.241392 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.240976 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b7f3220-f74a-4783-86e2-712784848c7b","Type":"ContainerDied","Data":"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d"} Jul 13 21:12:05.241392 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.241002 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b7f3220-f74a-4783-86e2-712784848c7b","Type":"ContainerDied","Data":"a2bfafdfd68c17e5595130e344e8d44fbd02ec18f1acf2c3cb27a83823b144f6"} Jul 13 21:12:05.249897 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.249641 2576 scope.go:117] "RemoveContainer" containerID="6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413" Jul 13 21:12:05.257400 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.257380 2576 scope.go:117] "RemoveContainer" containerID="0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106" Jul 13 21:12:05.263824 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.263804 2576 scope.go:117] "RemoveContainer" containerID="7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f" Jul 13 21:12:05.267111 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.267091 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 21:12:05.270809 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.270790 2576 scope.go:117] "RemoveContainer" containerID="243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1" Jul 13 21:12:05.272106 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.272087 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 21:12:05.278494 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.278478 2576 scope.go:117] "RemoveContainer" containerID="b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d" Jul 13 21:12:05.279198 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.279175 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" path="/var/lib/kubelet/pods/1b7f3220-f74a-4783-86e2-712784848c7b/volumes" Jul 13 21:12:05.285414 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.285400 2576 scope.go:117] "RemoveContainer" containerID="ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877" Jul 13 21:12:05.292056 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.292041 2576 scope.go:117] "RemoveContainer" containerID="add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db" Jul 13 21:12:05.292306 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:12:05.292289 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db\": container with ID starting with add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db not found: ID does not exist" containerID="add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db" Jul 13 21:12:05.292372 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.292318 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db"} err="failed to get container status \"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db\": rpc error: code = NotFound desc = could not find container \"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db\": container with ID starting with add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db not found: ID does not exist" Jul 13 21:12:05.292372 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.292347 2576 scope.go:117] "RemoveContainer" containerID="6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413" Jul 13 21:12:05.292583 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:12:05.292567 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413\": container with ID starting with 6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413 not found: ID does not exist" containerID="6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413" Jul 13 21:12:05.292624 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.292591 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413"} err="failed to get container status \"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413\": rpc error: code = NotFound desc = could not find container \"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413\": container with ID starting with 6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413 not found: ID does not exist" Jul 13 21:12:05.292624 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.292607 2576 scope.go:117] "RemoveContainer" containerID="0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106" Jul 13 21:12:05.292839 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:12:05.292823 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106\": container with ID starting with 0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106 not found: ID does not exist" containerID="0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106" Jul 13 21:12:05.292899 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.292844 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106"} err="failed to get container status \"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106\": rpc error: code = NotFound desc = could not find container \"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106\": container with ID starting with 0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106 not found: ID does not exist" Jul 13 21:12:05.292899 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.292882 2576 scope.go:117] "RemoveContainer" containerID="7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f" Jul 13 21:12:05.293100 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:12:05.293084 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f\": container with ID starting with 7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f not found: ID does not exist" containerID="7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f" Jul 13 21:12:05.293165 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.293107 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f"} err="failed to get container status \"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f\": rpc error: code = NotFound desc = could not find container \"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f\": container with ID starting with 7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f not found: ID does not exist" Jul 13 21:12:05.293165 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.293126 2576 scope.go:117] "RemoveContainer" containerID="243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1" Jul 13 21:12:05.293332 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:12:05.293316 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1\": container with ID starting with 243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1 not found: ID does not exist" containerID="243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1" Jul 13 21:12:05.293394 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.293337 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1"} err="failed to get container status \"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1\": rpc error: code = NotFound desc = could not find container \"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1\": container with ID starting with 243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1 not found: ID does not exist" Jul 13 21:12:05.293394 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.293354 2576 scope.go:117] "RemoveContainer" containerID="b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d" Jul 13 21:12:05.293585 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:12:05.293570 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d\": container with ID starting with b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d not found: ID does not exist" containerID="b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d" Jul 13 21:12:05.293625 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.293592 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d"} err="failed to get container status \"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d\": rpc error: code = NotFound desc = could not find container \"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d\": container with ID starting with b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d not found: ID does not exist" Jul 13 21:12:05.293625 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.293606 2576 scope.go:117] "RemoveContainer" containerID="ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877" Jul 13 21:12:05.293825 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:12:05.293808 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877\": container with ID starting with ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877 not found: ID does not exist" containerID="ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877" Jul 13 21:12:05.293894 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.293832 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877"} err="failed to get container status \"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877\": rpc error: code = NotFound desc = could not find container \"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877\": container with ID starting with ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877 not found: ID does not exist" Jul 13 21:12:05.293894 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.293846 2576 scope.go:117] "RemoveContainer" containerID="add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db" Jul 13 21:12:05.294141 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.294122 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db"} err="failed to get container status \"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db\": rpc error: code = NotFound desc = could not find container \"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db\": container with ID starting with add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db not found: ID does not exist" Jul 13 21:12:05.294202 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.294141 2576 scope.go:117] "RemoveContainer" containerID="6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413" Jul 13 21:12:05.294348 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.294334 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413"} err="failed to get container status \"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413\": rpc error: code = NotFound desc = could not find container \"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413\": container with ID starting with 6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413 not found: ID does not exist" Jul 13 21:12:05.294390 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.294349 2576 scope.go:117] "RemoveContainer" containerID="0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106" Jul 13 21:12:05.294578 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.294559 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106"} err="failed to get container status \"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106\": rpc error: code = NotFound desc = could not find container \"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106\": container with ID starting with 0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106 not found: ID does not exist" Jul 13 21:12:05.294623 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.294578 2576 scope.go:117] "RemoveContainer" containerID="7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f" Jul 13 21:12:05.294767 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.294748 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f"} err="failed to get container status \"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f\": rpc error: code = NotFound desc = could not find container \"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f\": container with ID starting with 7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f not found: ID does not exist" Jul 13 21:12:05.294803 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.294768 2576 scope.go:117] "RemoveContainer" containerID="243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1" Jul 13 21:12:05.294991 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.294974 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1"} err="failed to get container status \"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1\": rpc error: code = NotFound desc = could not find container \"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1\": container with ID starting with 243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1 not found: ID does not exist" Jul 13 21:12:05.295042 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.294993 2576 scope.go:117] "RemoveContainer" containerID="b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d" Jul 13 21:12:05.295227 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.295207 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d"} err="failed to get container status \"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d\": rpc error: code = NotFound desc = could not find container \"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d\": container with ID starting with b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d not found: ID does not exist" Jul 13 21:12:05.295298 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.295229 2576 scope.go:117] "RemoveContainer" containerID="ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877" Jul 13 21:12:05.295439 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.295422 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877"} err="failed to get container status \"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877\": rpc error: code = NotFound desc = could not find container \"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877\": container with ID starting with ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877 not found: ID does not exist" Jul 13 21:12:05.295483 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.295440 2576 scope.go:117] "RemoveContainer" containerID="add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db" Jul 13 21:12:05.295615 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.295598 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db"} err="failed to get container status \"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db\": rpc error: code = NotFound desc = could not find container \"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db\": container with ID starting with add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db not found: ID does not exist" Jul 13 21:12:05.295680 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.295617 2576 scope.go:117] "RemoveContainer" containerID="6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413" Jul 13 21:12:05.295816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.295801 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413"} err="failed to get container status \"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413\": rpc error: code = NotFound desc = could not find container \"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413\": container with ID starting with 6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413 not found: ID does not exist" Jul 13 21:12:05.295883 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.295816 2576 scope.go:117] "RemoveContainer" containerID="0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106" Jul 13 21:12:05.296002 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.295986 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106"} err="failed to get container status \"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106\": rpc error: code = NotFound desc = could not find container \"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106\": container with ID starting with 0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106 not found: ID does not exist" Jul 13 21:12:05.296049 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.296002 2576 scope.go:117] "RemoveContainer" containerID="7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f" Jul 13 21:12:05.296181 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.296167 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f"} err="failed to get container status \"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f\": rpc error: code = NotFound desc = could not find container \"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f\": container with ID starting with 7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f not found: ID does not exist" Jul 13 21:12:05.296224 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.296181 2576 scope.go:117] "RemoveContainer" containerID="243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1" Jul 13 21:12:05.296367 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.296353 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1"} err="failed to get container status \"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1\": rpc error: code = NotFound desc = could not find container \"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1\": container with ID starting with 243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1 not found: ID does not exist" Jul 13 21:12:05.296409 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.296367 2576 scope.go:117] "RemoveContainer" containerID="b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d" Jul 13 21:12:05.296533 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.296518 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d"} err="failed to get container status \"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d\": rpc error: code = NotFound desc = could not find container \"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d\": container with ID starting with b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d not found: ID does not exist" Jul 13 21:12:05.296574 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.296533 2576 scope.go:117] "RemoveContainer" containerID="ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877" Jul 13 21:12:05.296708 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.296695 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877"} err="failed to get container status \"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877\": rpc error: code = NotFound desc = could not find container \"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877\": container with ID starting with ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877 not found: ID does not exist" Jul 13 21:12:05.296744 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.296708 2576 scope.go:117] "RemoveContainer" containerID="add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db" Jul 13 21:12:05.296885 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.296867 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db"} err="failed to get container status \"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db\": rpc error: code = NotFound desc = could not find container \"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db\": container with ID starting with add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db not found: ID does not exist" Jul 13 21:12:05.296932 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.296886 2576 scope.go:117] "RemoveContainer" containerID="6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413" Jul 13 21:12:05.297072 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.297055 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413"} err="failed to get container status \"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413\": rpc error: code = NotFound desc = could not find container \"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413\": container with ID starting with 6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413 not found: ID does not exist" Jul 13 21:12:05.297118 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.297073 2576 scope.go:117] "RemoveContainer" containerID="0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106" Jul 13 21:12:05.297249 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.297234 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106"} err="failed to get container status \"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106\": rpc error: code = NotFound desc = could not find container \"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106\": container with ID starting with 0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106 not found: ID does not exist" Jul 13 21:12:05.297293 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.297250 2576 scope.go:117] "RemoveContainer" containerID="7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f" Jul 13 21:12:05.297424 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.297406 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f"} err="failed to get container status \"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f\": rpc error: code = NotFound desc = could not find container \"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f\": container with ID starting with 7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f not found: ID does not exist" Jul 13 21:12:05.297486 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.297424 2576 scope.go:117] "RemoveContainer" containerID="243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1" Jul 13 21:12:05.297641 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.297624 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1"} err="failed to get container status \"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1\": rpc error: code = NotFound desc = could not find container \"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1\": container with ID starting with 243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1 not found: ID does not exist" Jul 13 21:12:05.297702 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.297644 2576 scope.go:117] "RemoveContainer" containerID="b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d" Jul 13 21:12:05.297840 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.297822 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d"} err="failed to get container status \"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d\": rpc error: code = NotFound desc = could not find container \"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d\": container with ID starting with b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d not found: ID does not exist" Jul 13 21:12:05.297909 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.297841 2576 scope.go:117] "RemoveContainer" containerID="ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877" Jul 13 21:12:05.298062 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.298047 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877"} err="failed to get container status \"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877\": rpc error: code = NotFound desc = could not find container \"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877\": container with ID starting with ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877 not found: ID does not exist" Jul 13 21:12:05.298062 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.298062 2576 scope.go:117] "RemoveContainer" containerID="add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db" Jul 13 21:12:05.298280 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.298263 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db"} err="failed to get container status \"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db\": rpc error: code = NotFound desc = could not find container \"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db\": container with ID starting with add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db not found: ID does not exist" Jul 13 21:12:05.298331 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.298281 2576 scope.go:117] "RemoveContainer" containerID="6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413" Jul 13 21:12:05.298501 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.298485 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413"} err="failed to get container status \"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413\": rpc error: code = NotFound desc = could not find container \"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413\": container with ID starting with 6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413 not found: ID does not exist" Jul 13 21:12:05.298544 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.298501 2576 scope.go:117] "RemoveContainer" containerID="0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106" Jul 13 21:12:05.298722 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.298706 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106"} err="failed to get container status \"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106\": rpc error: code = NotFound desc = could not find container \"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106\": container with ID starting with 0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106 not found: ID does not exist" Jul 13 21:12:05.298762 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.298722 2576 scope.go:117] "RemoveContainer" containerID="7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f" Jul 13 21:12:05.298949 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.298933 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f"} err="failed to get container status \"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f\": rpc error: code = NotFound desc = could not find container \"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f\": container with ID starting with 7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f not found: ID does not exist" Jul 13 21:12:05.299001 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.298949 2576 scope.go:117] "RemoveContainer" containerID="243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1" Jul 13 21:12:05.299179 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.299140 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1"} err="failed to get container status \"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1\": rpc error: code = NotFound desc = could not find container \"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1\": container with ID starting with 243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1 not found: ID does not exist" Jul 13 21:12:05.299179 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.299156 2576 scope.go:117] "RemoveContainer" containerID="b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d" Jul 13 21:12:05.299457 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.299375 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d"} err="failed to get container status \"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d\": rpc error: code = NotFound desc = could not find container \"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d\": container with ID starting with b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d not found: ID does not exist" Jul 13 21:12:05.299457 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.299394 2576 scope.go:117] "RemoveContainer" containerID="ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877" Jul 13 21:12:05.299718 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.299697 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877"} err="failed to get container status \"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877\": rpc error: code = NotFound desc = could not find container \"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877\": container with ID starting with ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877 not found: ID does not exist" Jul 13 21:12:05.299790 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.299720 2576 scope.go:117] "RemoveContainer" containerID="add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db" Jul 13 21:12:05.300043 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.300021 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db"} err="failed to get container status \"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db\": rpc error: code = NotFound desc = could not find container \"add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db\": container with ID starting with add8cf913acad28407faa43b0302ef5d362452b173cfdb2edd6dc27e0558c5db not found: ID does not exist" Jul 13 21:12:05.300043 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.300041 2576 scope.go:117] "RemoveContainer" containerID="6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413" Jul 13 21:12:05.300309 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.300289 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413"} err="failed to get container status \"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413\": rpc error: code = NotFound desc = could not find container \"6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413\": container with ID starting with 6e24af55e0ef85a0b2a4ab8282e52edd3b204844a39433ccd8b2ec41b1d02413 not found: ID does not exist" Jul 13 21:12:05.300388 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.300311 2576 scope.go:117] "RemoveContainer" containerID="0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106" Jul 13 21:12:05.300551 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.300525 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106"} err="failed to get container status \"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106\": rpc error: code = NotFound desc = could not find container \"0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106\": container with ID starting with 0eff5443e3d6dceedee05f1bc0e9aba35f696c318337ca351125f287c2a7c106 not found: ID does not exist" Jul 13 21:12:05.300551 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.300548 2576 scope.go:117] "RemoveContainer" containerID="7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f" Jul 13 21:12:05.300832 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.300815 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f"} err="failed to get container status \"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f\": rpc error: code = NotFound desc = could not find container \"7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f\": container with ID starting with 7acdf7a83fde53ddf9a8b18e74d6db9fd0252651260b721cad9b8155cb1b515f not found: ID does not exist" Jul 13 21:12:05.300928 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.300834 2576 scope.go:117] "RemoveContainer" containerID="243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1" Jul 13 21:12:05.301237 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301212 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1"} err="failed to get container status \"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1\": rpc error: code = NotFound desc = could not find container \"243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1\": container with ID starting with 243dd805b2f485094896e3dc112aa7d74194f9871490d9332ebe92e5cdd7daf1 not found: ID does not exist" Jul 13 21:12:05.301237 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301237 2576 scope.go:117] "RemoveContainer" containerID="b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d" Jul 13 21:12:05.301508 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301486 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 21:12:05.301508 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301493 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d"} err="failed to get container status \"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d\": rpc error: code = NotFound desc = could not find container \"b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d\": container with ID starting with b43502ac15b3ed19fa2c2dd129cd7f103b9f3d98f309599a74c1706be6d22b8d not found: ID does not exist" Jul 13 21:12:05.301613 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301514 2576 scope.go:117] "RemoveContainer" containerID="ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877" Jul 13 21:12:05.301775 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301762 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="prometheus" Jul 13 21:12:05.301813 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301781 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="prometheus" Jul 13 21:12:05.301813 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301791 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="thanos-sidecar" Jul 13 21:12:05.301813 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301796 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="thanos-sidecar" Jul 13 21:12:05.301813 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301806 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="init-config-reloader" Jul 13 21:12:05.301813 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301812 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="init-config-reloader" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301819 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="kube-rbac-proxy" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301825 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="kube-rbac-proxy" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301831 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="config-reloader" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301836 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="config-reloader" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301757 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877"} err="failed to get container status \"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877\": rpc error: code = NotFound desc = could not find container \"ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877\": container with ID starting with ac1244db9292f85026101b081838afdccac32bc0b93c92c4bd59ccc1a3f40877 not found: ID does not exist" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301842 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="alertmanager" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301880 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="alertmanager" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301895 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="config-reloader" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301904 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="config-reloader" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301915 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="prom-label-proxy" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301920 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="prom-label-proxy" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301926 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="init-config-reloader" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301932 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="init-config-reloader" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301942 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="kube-rbac-proxy-web" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301946 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="kube-rbac-proxy-web" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301957 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="kube-rbac-proxy" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301970 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="kube-rbac-proxy" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301981 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="kube-rbac-proxy-thanos" Jul 13 21:12:05.301983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301986 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="kube-rbac-proxy-thanos" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301992 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="kube-rbac-proxy-web" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.301998 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="kube-rbac-proxy-web" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.302007 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="kube-rbac-proxy-metric" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.302012 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="kube-rbac-proxy-metric" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.302072 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="kube-rbac-proxy-web" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.302080 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="config-reloader" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.302086 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="prom-label-proxy" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.302091 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="prometheus" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.302098 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="thanos-sidecar" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.302105 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="alertmanager" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.302111 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="config-reloader" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.302116 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="kube-rbac-proxy" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.302123 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="kube-rbac-proxy-metric" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.302129 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="kube-rbac-proxy-web" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.302134 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="480b4617-6143-4d19-9417-5527b951d348" containerName="kube-rbac-proxy" Jul 13 21:12:05.302497 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.302139 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b7f3220-f74a-4783-86e2-712784848c7b" containerName="kube-rbac-proxy-thanos" Jul 13 21:12:05.306889 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.306870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.309169 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.309150 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 13 21:12:05.309272 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.309257 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 13 21:12:05.309499 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.309486 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 13 21:12:05.309631 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.309616 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 13 21:12:05.309815 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.309800 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 13 21:12:05.309930 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.309868 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 13 21:12:05.310034 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.310019 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 13 21:12:05.310129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.310074 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 13 21:12:05.310129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.310103 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 13 21:12:05.310129 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.310126 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ah6lhndd9eik1\"" Jul 13 21:12:05.310422 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.310399 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5qhl5\"" Jul 13 21:12:05.310491 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.310471 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 13 21:12:05.310787 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.310770 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 13 21:12:05.311322 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.311185 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 13 21:12:05.316231 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.314547 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 13 21:12:05.318406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.318385 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 13 21:12:05.319576 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.319556 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 13 21:12:05.323715 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.323696 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 21:12:05.427525 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.427525 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427475 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.427525 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.427525 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.427800 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427571 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.427800 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.427800 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.427800 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.427800 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.427800 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.428056 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.428056 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ctrh\" (UniqueName: \"kubernetes.io/projected/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-kube-api-access-5ctrh\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.428056 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.428056 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-web-config\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.428056 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-config-out\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.428056 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.428056 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.427970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-config\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.428056 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.428003 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.428056 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.428019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.428056 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.428033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.528807 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.528768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.528998 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.528809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.528998 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.528833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.528998 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.528874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ctrh\" (UniqueName: \"kubernetes.io/projected/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-kube-api-access-5ctrh\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.528998 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.528905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.528998 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.528928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-web-config\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529239 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-config-out\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529239 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529239 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-config\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529239 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529239 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529489 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529489 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529489 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529489 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529489 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529489 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529489 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529817 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529817 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529531 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529817 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.529817 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.529638 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.530332 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.530307 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.530492 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.530381 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.531139 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.531111 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.531811 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.531784 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.532436 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.532409 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.532436 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.532427 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.533829 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.533776 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-config-out\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.534096 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.534073 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.534246 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.534118 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-web-config\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.534338 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.534169 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.534338 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.534232 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.534409 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.534371 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.534710 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.534687 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.534830 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.534806 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-config\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.534956 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.534830 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.535034 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.535012 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.535091 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.535065 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.536774 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.536741 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ctrh\" (UniqueName: \"kubernetes.io/projected/3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3-kube-api-access-5ctrh\") pod \"prometheus-k8s-0\" (UID: \"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.620039 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.620005 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:12:05.767659 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:05.767633 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 21:12:05.770205 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:12:05.770164 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd3ebd5_03c3_44a5_b00d_2d7ab3a092d3.slice/crio-e0b347cfd02eb5312af87d9bf9efe0ac655ffea478d24ede37c8bd2b301309d1 WatchSource:0}: Error finding container e0b347cfd02eb5312af87d9bf9efe0ac655ffea478d24ede37c8bd2b301309d1: Status 404 returned error can't find the container with id e0b347cfd02eb5312af87d9bf9efe0ac655ffea478d24ede37c8bd2b301309d1 Jul 13 21:12:06.245495 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:06.245463 2576 generic.go:356] "Generic (PLEG): container finished" podID="3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3" containerID="fcc3581b1d346df82a9b09d83b54a2644b039f53ee004989855d1eb18862088a" exitCode=0 Jul 13 21:12:06.245898 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:06.245549 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3","Type":"ContainerDied","Data":"fcc3581b1d346df82a9b09d83b54a2644b039f53ee004989855d1eb18862088a"} Jul 13 21:12:06.245898 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:06.245625 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3","Type":"ContainerStarted","Data":"e0b347cfd02eb5312af87d9bf9efe0ac655ffea478d24ede37c8bd2b301309d1"} Jul 13 21:12:07.254312 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:07.254279 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3","Type":"ContainerStarted","Data":"bb7ab01aa48da97c0510f8e98b5fcf9622d9955441940636122f71f02fe449e6"} Jul 13 21:12:07.254661 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:07.254343 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3","Type":"ContainerStarted","Data":"40e4897d03426cfd02856ceada77af8fb7d66d9e84f699b8d8dba9c710d5ee68"} Jul 13 21:12:07.254661 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:07.254371 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3","Type":"ContainerStarted","Data":"b43aa70f05be539b709e625f747043cc4b4034fbd905849f96449a79452d7c59"} Jul 13 21:12:07.254661 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:07.254395 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3","Type":"ContainerStarted","Data":"59f98815b28efb5a3774d9777ce9f381797b06f5ad0f3e95a32cf3d0af3d0222"} Jul 13 21:12:07.254661 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:07.254419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3","Type":"ContainerStarted","Data":"d8c2b79f61b39785b241203497f22343f5aea59bccdbd604c758da053b9ea114"} Jul 13 21:12:07.254661 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:07.254443 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3","Type":"ContainerStarted","Data":"0c1e7c2c50b6f17d9c0af63134af89799a158d79fd9d1d745b05ae617cdb8f39"} Jul 13 21:12:07.281641 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:07.281539 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.263334312 podStartE2EDuration="2.281518251s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.183939ms" isStatefulPod=false podCreationTimestamp="2026-07-13 21:12:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:07.28010673 +0000 UTC m=+166.612771187" watchObservedRunningTime="2026-07-13 21:12:07.281518251 +0000 UTC m=+166.614182695" Jul 13 21:12:10.620739 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:12:10.620692 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:13:05.620729 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:13:05.620691 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:13:05.636378 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:13:05.636353 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:13:06.486053 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:13:06.486026 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 21:14:08.003346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.003313 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx"] Jul 13 21:14:08.005534 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.005519 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.008621 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.008595 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 21:14:08.008765 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.008746 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8vjt2\"" Jul 13 21:14:08.008827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.008791 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 21:14:08.009047 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.009033 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 21:14:08.016034 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.016018 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 21:14:08.041256 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.041227 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx"] Jul 13 21:14:08.137367 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.137333 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csxft\" (UniqueName: \"kubernetes.io/projected/ed4f1e8a-8b47-462c-bd29-5c43682e586f-kube-api-access-csxft\") pod \"opendatahub-operator-controller-manager-84fb46456c-kpxtx\" (UID: \"ed4f1e8a-8b47-462c-bd29-5c43682e586f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.137545 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.137377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed4f1e8a-8b47-462c-bd29-5c43682e586f-manifests\") pod \"opendatahub-operator-controller-manager-84fb46456c-kpxtx\" (UID: \"ed4f1e8a-8b47-462c-bd29-5c43682e586f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.137545 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.137439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed4f1e8a-8b47-462c-bd29-5c43682e586f-tmp\") pod \"opendatahub-operator-controller-manager-84fb46456c-kpxtx\" (UID: \"ed4f1e8a-8b47-462c-bd29-5c43682e586f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.137545 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.137461 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed4f1e8a-8b47-462c-bd29-5c43682e586f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84fb46456c-kpxtx\" (UID: \"ed4f1e8a-8b47-462c-bd29-5c43682e586f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.137545 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.137493 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed4f1e8a-8b47-462c-bd29-5c43682e586f-webhook-cert\") pod \"opendatahub-operator-controller-manager-84fb46456c-kpxtx\" (UID: \"ed4f1e8a-8b47-462c-bd29-5c43682e586f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.238624 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.238584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed4f1e8a-8b47-462c-bd29-5c43682e586f-manifests\") pod \"opendatahub-operator-controller-manager-84fb46456c-kpxtx\" (UID: \"ed4f1e8a-8b47-462c-bd29-5c43682e586f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.238816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.238645 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed4f1e8a-8b47-462c-bd29-5c43682e586f-tmp\") pod \"opendatahub-operator-controller-manager-84fb46456c-kpxtx\" (UID: \"ed4f1e8a-8b47-462c-bd29-5c43682e586f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.238816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.238677 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed4f1e8a-8b47-462c-bd29-5c43682e586f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84fb46456c-kpxtx\" (UID: \"ed4f1e8a-8b47-462c-bd29-5c43682e586f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.238816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.238714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed4f1e8a-8b47-462c-bd29-5c43682e586f-webhook-cert\") pod \"opendatahub-operator-controller-manager-84fb46456c-kpxtx\" (UID: \"ed4f1e8a-8b47-462c-bd29-5c43682e586f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.238816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.238768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csxft\" (UniqueName: \"kubernetes.io/projected/ed4f1e8a-8b47-462c-bd29-5c43682e586f-kube-api-access-csxft\") pod \"opendatahub-operator-controller-manager-84fb46456c-kpxtx\" (UID: \"ed4f1e8a-8b47-462c-bd29-5c43682e586f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.239097 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.239071 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed4f1e8a-8b47-462c-bd29-5c43682e586f-manifests\") pod \"opendatahub-operator-controller-manager-84fb46456c-kpxtx\" (UID: \"ed4f1e8a-8b47-462c-bd29-5c43682e586f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.240980 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.240951 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed4f1e8a-8b47-462c-bd29-5c43682e586f-tmp\") pod \"opendatahub-operator-controller-manager-84fb46456c-kpxtx\" (UID: \"ed4f1e8a-8b47-462c-bd29-5c43682e586f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.241225 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.241206 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed4f1e8a-8b47-462c-bd29-5c43682e586f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84fb46456c-kpxtx\" (UID: \"ed4f1e8a-8b47-462c-bd29-5c43682e586f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.241291 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.241247 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed4f1e8a-8b47-462c-bd29-5c43682e586f-webhook-cert\") pod \"opendatahub-operator-controller-manager-84fb46456c-kpxtx\" (UID: \"ed4f1e8a-8b47-462c-bd29-5c43682e586f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.246718 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.246698 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csxft\" (UniqueName: \"kubernetes.io/projected/ed4f1e8a-8b47-462c-bd29-5c43682e586f-kube-api-access-csxft\") pod \"opendatahub-operator-controller-manager-84fb46456c-kpxtx\" (UID: \"ed4f1e8a-8b47-462c-bd29-5c43682e586f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.315441 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.315363 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:08.450004 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.449981 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx"] Jul 13 21:14:08.452531 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:14:08.452502 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4f1e8a_8b47_462c_bd29_5c43682e586f.slice/crio-3af93b68551c5b35ec8750027f24678eaaa8d888a13d37fccc6f2c8b29e12164 WatchSource:0}: Error finding container 3af93b68551c5b35ec8750027f24678eaaa8d888a13d37fccc6f2c8b29e12164: Status 404 returned error can't find the container with id 3af93b68551c5b35ec8750027f24678eaaa8d888a13d37fccc6f2c8b29e12164 Jul 13 21:14:08.707557 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:08.707519 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" event={"ID":"ed4f1e8a-8b47-462c-bd29-5c43682e586f","Type":"ContainerStarted","Data":"3af93b68551c5b35ec8750027f24678eaaa8d888a13d37fccc6f2c8b29e12164"} Jul 13 21:14:12.728647 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:12.728610 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" event={"ID":"ed4f1e8a-8b47-462c-bd29-5c43682e586f","Type":"ContainerStarted","Data":"f7c6a46bc9fc8c03870c712fbeb43f227babfdbf9ab164df6d24785248b6c645"} Jul 13 21:14:13.734582 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:13.734545 2576 generic.go:356] "Generic (PLEG): container finished" podID="ed4f1e8a-8b47-462c-bd29-5c43682e586f" containerID="f7c6a46bc9fc8c03870c712fbeb43f227babfdbf9ab164df6d24785248b6c645" exitCode=0 Jul 13 21:14:13.735011 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:13.734632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" event={"ID":"ed4f1e8a-8b47-462c-bd29-5c43682e586f","Type":"ContainerDied","Data":"f7c6a46bc9fc8c03870c712fbeb43f227babfdbf9ab164df6d24785248b6c645"} Jul 13 21:14:14.740334 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:14.740300 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" event={"ID":"ed4f1e8a-8b47-462c-bd29-5c43682e586f","Type":"ContainerStarted","Data":"eb23f6011275f7fd168668fc601b1c5f7f0665c982e4f69085c74a382b23fd66"} Jul 13 21:14:14.740752 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:14.740418 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:14.766681 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:14.766632 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" podStartSLOduration=3.063971349 podStartE2EDuration="7.766587994s" totalImagesPullingTime="3.6249686s" totalInitContainerRuntime="1.077648045s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:14:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:14:14.763764616 +0000 UTC m=+294.096429068" watchObservedRunningTime="2026-07-13 21:14:14.766587994 +0000 UTC m=+294.099252434" Jul 13 21:14:21.124633 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:21.124597 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 21:14:25.746846 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:25.746807 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84fb46456c-kpxtx" Jul 13 21:14:27.207846 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.207813 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr"] Jul 13 21:14:27.209906 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.209890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:14:27.212755 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.212729 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sn56t\"" Jul 13 21:14:27.212894 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.212800 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 13 21:14:27.213761 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.213740 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 21:14:27.213761 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.213755 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 21:14:27.214125 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.213769 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 13 21:14:27.214125 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.213820 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 13 21:14:27.229726 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.229704 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr"] Jul 13 21:14:27.302559 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.302528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1d21e21-610e-448d-aacf-06a502556317-cert\") pod \"lws-controller-manager-588f9fd4c6-bxjzr\" (UID: \"a1d21e21-610e-448d-aacf-06a502556317\") " pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:14:27.303008 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.302560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1d21e21-610e-448d-aacf-06a502556317-metrics-cert\") pod \"lws-controller-manager-588f9fd4c6-bxjzr\" (UID: \"a1d21e21-610e-448d-aacf-06a502556317\") " pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:14:27.303110 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.303043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g8qs\" (UniqueName: \"kubernetes.io/projected/a1d21e21-610e-448d-aacf-06a502556317-kube-api-access-5g8qs\") pod \"lws-controller-manager-588f9fd4c6-bxjzr\" (UID: \"a1d21e21-610e-448d-aacf-06a502556317\") " pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:14:27.303170 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.303147 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a1d21e21-610e-448d-aacf-06a502556317-manager-config\") pod \"lws-controller-manager-588f9fd4c6-bxjzr\" (UID: \"a1d21e21-610e-448d-aacf-06a502556317\") " pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:14:27.404176 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.404137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a1d21e21-610e-448d-aacf-06a502556317-manager-config\") pod \"lws-controller-manager-588f9fd4c6-bxjzr\" (UID: \"a1d21e21-610e-448d-aacf-06a502556317\") " pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:14:27.404375 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.404232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1d21e21-610e-448d-aacf-06a502556317-cert\") pod \"lws-controller-manager-588f9fd4c6-bxjzr\" (UID: \"a1d21e21-610e-448d-aacf-06a502556317\") " pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:14:27.404375 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.404248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1d21e21-610e-448d-aacf-06a502556317-metrics-cert\") pod \"lws-controller-manager-588f9fd4c6-bxjzr\" (UID: \"a1d21e21-610e-448d-aacf-06a502556317\") " pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:14:27.404545 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.404377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8qs\" (UniqueName: \"kubernetes.io/projected/a1d21e21-610e-448d-aacf-06a502556317-kube-api-access-5g8qs\") pod \"lws-controller-manager-588f9fd4c6-bxjzr\" (UID: \"a1d21e21-610e-448d-aacf-06a502556317\") " pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:14:27.404966 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.404941 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a1d21e21-610e-448d-aacf-06a502556317-manager-config\") pod \"lws-controller-manager-588f9fd4c6-bxjzr\" (UID: \"a1d21e21-610e-448d-aacf-06a502556317\") " pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:14:27.406683 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.406662 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1d21e21-610e-448d-aacf-06a502556317-cert\") pod \"lws-controller-manager-588f9fd4c6-bxjzr\" (UID: \"a1d21e21-610e-448d-aacf-06a502556317\") " pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:14:27.406774 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.406697 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1d21e21-610e-448d-aacf-06a502556317-metrics-cert\") pod \"lws-controller-manager-588f9fd4c6-bxjzr\" (UID: \"a1d21e21-610e-448d-aacf-06a502556317\") " pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:14:27.417710 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.417687 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g8qs\" (UniqueName: \"kubernetes.io/projected/a1d21e21-610e-448d-aacf-06a502556317-kube-api-access-5g8qs\") pod \"lws-controller-manager-588f9fd4c6-bxjzr\" (UID: \"a1d21e21-610e-448d-aacf-06a502556317\") " pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:14:27.519729 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.519641 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:14:27.671160 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.671136 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr"] Jul 13 21:14:27.673275 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:14:27.673249 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d21e21_610e_448d_aacf_06a502556317.slice/crio-2b0b6de5523639dd314e892ed2fcd18c6d1017bc4285e95f57918d1a9da78c6a WatchSource:0}: Error finding container 2b0b6de5523639dd314e892ed2fcd18c6d1017bc4285e95f57918d1a9da78c6a: Status 404 returned error can't find the container with id 2b0b6de5523639dd314e892ed2fcd18c6d1017bc4285e95f57918d1a9da78c6a Jul 13 21:14:27.675510 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.675493 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 21:14:27.677105 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.677086 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl"] Jul 13 21:14:27.680158 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.680139 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl" Jul 13 21:14:27.684471 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.684273 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 21:14:27.684471 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.684385 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pkscq\"" Jul 13 21:14:27.684471 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.684400 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 13 21:14:27.684471 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.684437 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 21:14:27.684738 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.684385 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 13 21:14:27.700226 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.700201 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl"] Jul 13 21:14:27.802848 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.802740 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" event={"ID":"a1d21e21-610e-448d-aacf-06a502556317","Type":"ContainerStarted","Data":"2b0b6de5523639dd314e892ed2fcd18c6d1017bc4285e95f57918d1a9da78c6a"} Jul 13 21:14:27.808062 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.808037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a10fa60-a87f-47fb-b871-84e8a7d2b44a-tmp\") pod \"kube-auth-proxy-575f48bc89-tv6pl\" (UID: \"2a10fa60-a87f-47fb-b871-84e8a7d2b44a\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl" Jul 13 21:14:27.808187 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.808077 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wktjq\" (UniqueName: \"kubernetes.io/projected/2a10fa60-a87f-47fb-b871-84e8a7d2b44a-kube-api-access-wktjq\") pod \"kube-auth-proxy-575f48bc89-tv6pl\" (UID: \"2a10fa60-a87f-47fb-b871-84e8a7d2b44a\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl" Jul 13 21:14:27.808187 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.808121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a10fa60-a87f-47fb-b871-84e8a7d2b44a-tls-certs\") pod \"kube-auth-proxy-575f48bc89-tv6pl\" (UID: \"2a10fa60-a87f-47fb-b871-84e8a7d2b44a\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl" Jul 13 21:14:27.908560 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.908518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a10fa60-a87f-47fb-b871-84e8a7d2b44a-tls-certs\") pod \"kube-auth-proxy-575f48bc89-tv6pl\" (UID: \"2a10fa60-a87f-47fb-b871-84e8a7d2b44a\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl" Jul 13 21:14:27.908756 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.908596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a10fa60-a87f-47fb-b871-84e8a7d2b44a-tmp\") pod \"kube-auth-proxy-575f48bc89-tv6pl\" (UID: \"2a10fa60-a87f-47fb-b871-84e8a7d2b44a\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl" Jul 13 21:14:27.908756 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.908638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wktjq\" (UniqueName: \"kubernetes.io/projected/2a10fa60-a87f-47fb-b871-84e8a7d2b44a-kube-api-access-wktjq\") pod \"kube-auth-proxy-575f48bc89-tv6pl\" (UID: \"2a10fa60-a87f-47fb-b871-84e8a7d2b44a\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl" Jul 13 21:14:27.908756 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:14:27.908679 2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 13 21:14:27.908756 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:14:27.908736 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a10fa60-a87f-47fb-b871-84e8a7d2b44a-tls-certs podName:2a10fa60-a87f-47fb-b871-84e8a7d2b44a nodeName:}" failed. No retries permitted until 2026-07-13 21:14:28.408720281 +0000 UTC m=+307.741384699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2a10fa60-a87f-47fb-b871-84e8a7d2b44a-tls-certs") pod "kube-auth-proxy-575f48bc89-tv6pl" (UID: "2a10fa60-a87f-47fb-b871-84e8a7d2b44a") : secret "kube-auth-proxy-tls" not found Jul 13 21:14:27.910937 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.910914 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a10fa60-a87f-47fb-b871-84e8a7d2b44a-tmp\") pod \"kube-auth-proxy-575f48bc89-tv6pl\" (UID: \"2a10fa60-a87f-47fb-b871-84e8a7d2b44a\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl" Jul 13 21:14:27.934469 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:27.934432 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wktjq\" (UniqueName: \"kubernetes.io/projected/2a10fa60-a87f-47fb-b871-84e8a7d2b44a-kube-api-access-wktjq\") pod \"kube-auth-proxy-575f48bc89-tv6pl\" (UID: \"2a10fa60-a87f-47fb-b871-84e8a7d2b44a\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl" Jul 13 21:14:28.413306 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:28.413265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a10fa60-a87f-47fb-b871-84e8a7d2b44a-tls-certs\") pod \"kube-auth-proxy-575f48bc89-tv6pl\" (UID: \"2a10fa60-a87f-47fb-b871-84e8a7d2b44a\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl" Jul 13 21:14:28.415712 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:28.415684 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a10fa60-a87f-47fb-b871-84e8a7d2b44a-tls-certs\") pod \"kube-auth-proxy-575f48bc89-tv6pl\" (UID: \"2a10fa60-a87f-47fb-b871-84e8a7d2b44a\") " pod="openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl" Jul 13 21:14:28.590922 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:28.590888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl" Jul 13 21:14:28.762288 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:28.762257 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl"] Jul 13 21:14:28.764977 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:14:28.764948 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a10fa60_a87f_47fb_b871_84e8a7d2b44a.slice/crio-ecb2f4a5d3736f7fadc88b08ba0a41d54304c1a1747e495dfd261a33d05ea5ec WatchSource:0}: Error finding container ecb2f4a5d3736f7fadc88b08ba0a41d54304c1a1747e495dfd261a33d05ea5ec: Status 404 returned error can't find the container with id ecb2f4a5d3736f7fadc88b08ba0a41d54304c1a1747e495dfd261a33d05ea5ec Jul 13 21:14:28.814975 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:28.814906 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl" event={"ID":"2a10fa60-a87f-47fb-b871-84e8a7d2b44a","Type":"ContainerStarted","Data":"ecb2f4a5d3736f7fadc88b08ba0a41d54304c1a1747e495dfd261a33d05ea5ec"} Jul 13 21:14:30.831003 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:30.830960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" event={"ID":"a1d21e21-610e-448d-aacf-06a502556317","Type":"ContainerStarted","Data":"5babe8e58a2a924b3302653f7ece0a9a9fe4b216661a4d5cf792a17614b6c1c4"} Jul 13 21:14:30.831504 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:30.831126 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:14:30.848016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:30.847963 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" podStartSLOduration=1.270398473 podStartE2EDuration="3.847947862s" totalImagesPullingTime="2.577549389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:14:30.846755158 +0000 UTC m=+310.179419600" watchObservedRunningTime="2026-07-13 21:14:30.847947862 +0000 UTC m=+310.180612303" Jul 13 21:14:32.841300 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:32.841263 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl" event={"ID":"2a10fa60-a87f-47fb-b871-84e8a7d2b44a","Type":"ContainerStarted","Data":"869a4fc922fac143f2391ae93eeb9c080f983a8c544d1202912f9034b65b3993"} Jul 13 21:14:32.858489 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:32.858443 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-575f48bc89-tv6pl" podStartSLOduration=2.599776049 podStartE2EDuration="5.858429157s" totalImagesPullingTime="3.258653108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:14:32.857663267 +0000 UTC m=+312.190327707" watchObservedRunningTime="2026-07-13 21:14:32.858429157 +0000 UTC m=+312.191093597" Jul 13 21:14:41.838291 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:14:41.838262 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-588f9fd4c6-bxjzr" Jul 13 21:16:22.818552 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:22.818518 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb"] Jul 13 21:16:22.821576 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:22.821559 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb" Jul 13 21:16:22.824075 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:22.824047 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jctlp\"" Jul 13 21:16:22.824227 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:22.824123 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 13 21:16:22.824950 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:22.824930 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 21:16:22.825069 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:22.825049 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 13 21:16:22.825245 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:22.825223 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 21:16:22.832518 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:22.832498 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb"] Jul 13 21:16:22.954371 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:22.954334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94nhp\" (UniqueName: \"kubernetes.io/projected/47f97d25-ccb5-482d-896a-8be156dac09b-kube-api-access-94nhp\") pod \"kuadrant-console-plugin-66b5774985-72zgb\" (UID: \"47f97d25-ccb5-482d-896a-8be156dac09b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb" Jul 13 21:16:22.954538 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:22.954385 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/47f97d25-ccb5-482d-896a-8be156dac09b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-72zgb\" (UID: \"47f97d25-ccb5-482d-896a-8be156dac09b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb" Jul 13 21:16:22.954538 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:22.954455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/47f97d25-ccb5-482d-896a-8be156dac09b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-72zgb\" (UID: \"47f97d25-ccb5-482d-896a-8be156dac09b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb" Jul 13 21:16:23.055184 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:23.055152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/47f97d25-ccb5-482d-896a-8be156dac09b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-72zgb\" (UID: \"47f97d25-ccb5-482d-896a-8be156dac09b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb" Jul 13 21:16:23.055355 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:23.055203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/47f97d25-ccb5-482d-896a-8be156dac09b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-72zgb\" (UID: \"47f97d25-ccb5-482d-896a-8be156dac09b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb" Jul 13 21:16:23.055355 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:23.055276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94nhp\" (UniqueName: \"kubernetes.io/projected/47f97d25-ccb5-482d-896a-8be156dac09b-kube-api-access-94nhp\") pod \"kuadrant-console-plugin-66b5774985-72zgb\" (UID: \"47f97d25-ccb5-482d-896a-8be156dac09b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb" Jul 13 21:16:23.055437 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:16:23.055368 2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 13 21:16:23.055482 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:16:23.055442 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47f97d25-ccb5-482d-896a-8be156dac09b-plugin-serving-cert podName:47f97d25-ccb5-482d-896a-8be156dac09b nodeName:}" failed. No retries permitted until 2026-07-13 21:16:23.555422223 +0000 UTC m=+422.888086644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/47f97d25-ccb5-482d-896a-8be156dac09b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-72zgb" (UID: "47f97d25-ccb5-482d-896a-8be156dac09b") : secret "plugin-serving-cert" not found Jul 13 21:16:23.055895 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:23.055849 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/47f97d25-ccb5-482d-896a-8be156dac09b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-72zgb\" (UID: \"47f97d25-ccb5-482d-896a-8be156dac09b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb" Jul 13 21:16:23.068503 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:23.068477 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94nhp\" (UniqueName: \"kubernetes.io/projected/47f97d25-ccb5-482d-896a-8be156dac09b-kube-api-access-94nhp\") pod \"kuadrant-console-plugin-66b5774985-72zgb\" (UID: \"47f97d25-ccb5-482d-896a-8be156dac09b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb" Jul 13 21:16:23.559307 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:23.559267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/47f97d25-ccb5-482d-896a-8be156dac09b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-72zgb\" (UID: \"47f97d25-ccb5-482d-896a-8be156dac09b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb" Jul 13 21:16:23.561698 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:23.561679 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/47f97d25-ccb5-482d-896a-8be156dac09b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-72zgb\" (UID: \"47f97d25-ccb5-482d-896a-8be156dac09b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb" Jul 13 21:16:23.737704 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:23.737668 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb" Jul 13 21:16:23.869969 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:23.869945 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb"] Jul 13 21:16:23.872588 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:16:23.872560 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47f97d25_ccb5_482d_896a_8be156dac09b.slice/crio-966e622a1007d54fe40dfa37513ca5b0a0b2a41528c4eb790836b0e6307232ca WatchSource:0}: Error finding container 966e622a1007d54fe40dfa37513ca5b0a0b2a41528c4eb790836b0e6307232ca: Status 404 returned error can't find the container with id 966e622a1007d54fe40dfa37513ca5b0a0b2a41528c4eb790836b0e6307232ca Jul 13 21:16:24.299774 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:24.299736 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb" event={"ID":"47f97d25-ccb5-482d-896a-8be156dac09b","Type":"ContainerStarted","Data":"966e622a1007d54fe40dfa37513ca5b0a0b2a41528c4eb790836b0e6307232ca"} Jul 13 21:16:32.782783 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:32.782747 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z"] Jul 13 21:16:32.791057 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:32.791034 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:32.793865 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:32.793827 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w5gbw\"" Jul 13 21:16:32.798991 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:32.798966 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z"] Jul 13 21:16:32.948447 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:32.948407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tknpc\" (UniqueName: \"kubernetes.io/projected/825acf66-470e-434c-8ec3-8a53fcd6e8f6-kube-api-access-tknpc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lm88z\" (UID: \"825acf66-470e-434c-8ec3-8a53fcd6e8f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:32.948638 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:32.948469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/825acf66-470e-434c-8ec3-8a53fcd6e8f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lm88z\" (UID: \"825acf66-470e-434c-8ec3-8a53fcd6e8f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:33.049504 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.049412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tknpc\" (UniqueName: \"kubernetes.io/projected/825acf66-470e-434c-8ec3-8a53fcd6e8f6-kube-api-access-tknpc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lm88z\" (UID: \"825acf66-470e-434c-8ec3-8a53fcd6e8f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:33.049504 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.049479 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/825acf66-470e-434c-8ec3-8a53fcd6e8f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lm88z\" (UID: \"825acf66-470e-434c-8ec3-8a53fcd6e8f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:33.049891 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.049849 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/825acf66-470e-434c-8ec3-8a53fcd6e8f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lm88z\" (UID: \"825acf66-470e-434c-8ec3-8a53fcd6e8f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:33.071661 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.071628 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tknpc\" (UniqueName: \"kubernetes.io/projected/825acf66-470e-434c-8ec3-8a53fcd6e8f6-kube-api-access-tknpc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lm88z\" (UID: \"825acf66-470e-434c-8ec3-8a53fcd6e8f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:33.104508 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.104470 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:33.429238 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.429151 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z"] Jul 13 21:16:33.434896 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.434846 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z"] Jul 13 21:16:33.450124 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.450094 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd"] Jul 13 21:16:33.455507 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.455482 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" Jul 13 21:16:33.467875 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.467835 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd"] Jul 13 21:16:33.554703 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.554668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c49620b-8006-4ce8-9aac-8f38d675ae77-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ktmvd\" (UID: \"2c49620b-8006-4ce8-9aac-8f38d675ae77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" Jul 13 21:16:33.554872 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.554795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vpnl\" (UniqueName: \"kubernetes.io/projected/2c49620b-8006-4ce8-9aac-8f38d675ae77-kube-api-access-7vpnl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ktmvd\" (UID: \"2c49620b-8006-4ce8-9aac-8f38d675ae77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" Jul 13 21:16:33.655251 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.655213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vpnl\" (UniqueName: \"kubernetes.io/projected/2c49620b-8006-4ce8-9aac-8f38d675ae77-kube-api-access-7vpnl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ktmvd\" (UID: \"2c49620b-8006-4ce8-9aac-8f38d675ae77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" Jul 13 21:16:33.655453 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.655274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c49620b-8006-4ce8-9aac-8f38d675ae77-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ktmvd\" (UID: \"2c49620b-8006-4ce8-9aac-8f38d675ae77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" Jul 13 21:16:33.655661 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.655641 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c49620b-8006-4ce8-9aac-8f38d675ae77-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ktmvd\" (UID: \"2c49620b-8006-4ce8-9aac-8f38d675ae77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" Jul 13 21:16:33.667519 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.667487 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vpnl\" (UniqueName: \"kubernetes.io/projected/2c49620b-8006-4ce8-9aac-8f38d675ae77-kube-api-access-7vpnl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ktmvd\" (UID: \"2c49620b-8006-4ce8-9aac-8f38d675ae77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" Jul 13 21:16:33.769073 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:33.769036 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" Jul 13 21:16:46.310797 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:46.310772 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd"] Jul 13 21:16:46.313174 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:16:46.313152 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c49620b_8006_4ce8_9aac_8f38d675ae77.slice/crio-cb3c39fb32a05b971a002f523545e5c726e30100865a909ad2731c0ef8bc4e12 WatchSource:0}: Error finding container cb3c39fb32a05b971a002f523545e5c726e30100865a909ad2731c0ef8bc4e12: Status 404 returned error can't find the container with id cb3c39fb32a05b971a002f523545e5c726e30100865a909ad2731c0ef8bc4e12 Jul 13 21:16:46.424521 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:46.424431 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb" event={"ID":"47f97d25-ccb5-482d-896a-8be156dac09b","Type":"ContainerStarted","Data":"d1bda84e27366f496f9a732e14957c29e4dbad6a433bde7c37e3166d78e589cf"} Jul 13 21:16:46.425756 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:46.425731 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" event={"ID":"2c49620b-8006-4ce8-9aac-8f38d675ae77","Type":"ContainerStarted","Data":"cb3c39fb32a05b971a002f523545e5c726e30100865a909ad2731c0ef8bc4e12"} Jul 13 21:16:46.444684 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:46.444640 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72zgb" podStartSLOduration=2.101665019 podStartE2EDuration="24.444624409s" totalImagesPullingTime="22.34295939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:16:46.444255279 +0000 UTC m=+445.776919722" watchObservedRunningTime="2026-07-13 21:16:46.444624409 +0000 UTC m=+445.777288853" Jul 13 21:16:48.699404 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:16:48.699364 2576 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-lm88z_kuadrant-system_825acf66-470e-434c-8ec3-8a53fcd6e8f6_0(6379b6621b393f0ed209855a2a8ddb01109c9d394582182995f243b7e5deb2a9): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-lm88z to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jul 13 21:16:48.699659 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:16:48.699429 2576 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-lm88z_kuadrant-system_825acf66-470e-434c-8ec3-8a53fcd6e8f6_0(6379b6621b393f0ed209855a2a8ddb01109c9d394582182995f243b7e5deb2a9): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-lm88z to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:49.440224 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:49.440195 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:49.442277 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:16:49.442245 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-lm88z\" is forbidden: User \"system:node:ip-10-0-133-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-136.ec2.internal' and this object" podUID="825acf66-470e-434c-8ec3-8a53fcd6e8f6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:49.447956 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:49.447937 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:49.450132 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:16:49.450103 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-lm88z\" is forbidden: User \"system:node:ip-10-0-133-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-136.ec2.internal' and this object" podUID="825acf66-470e-434c-8ec3-8a53fcd6e8f6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:49.486733 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:49.486701 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tknpc\" (UniqueName: \"kubernetes.io/projected/825acf66-470e-434c-8ec3-8a53fcd6e8f6-kube-api-access-tknpc\") pod \"825acf66-470e-434c-8ec3-8a53fcd6e8f6\" (UID: \"825acf66-470e-434c-8ec3-8a53fcd6e8f6\") " Jul 13 21:16:49.486901 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:49.486751 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/825acf66-470e-434c-8ec3-8a53fcd6e8f6-extensions-socket-volume\") pod \"825acf66-470e-434c-8ec3-8a53fcd6e8f6\" (UID: \"825acf66-470e-434c-8ec3-8a53fcd6e8f6\") " Jul 13 21:16:49.487100 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:49.487064 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/825acf66-470e-434c-8ec3-8a53fcd6e8f6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "825acf66-470e-434c-8ec3-8a53fcd6e8f6" (UID: "825acf66-470e-434c-8ec3-8a53fcd6e8f6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:16:49.488945 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:49.488922 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/825acf66-470e-434c-8ec3-8a53fcd6e8f6-kube-api-access-tknpc" (OuterVolumeSpecName: "kube-api-access-tknpc") pod "825acf66-470e-434c-8ec3-8a53fcd6e8f6" (UID: "825acf66-470e-434c-8ec3-8a53fcd6e8f6"). InnerVolumeSpecName "kube-api-access-tknpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:16:49.588256 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:49.588219 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/825acf66-470e-434c-8ec3-8a53fcd6e8f6-extensions-socket-volume\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:16:49.588256 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:49.588256 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tknpc\" (UniqueName: \"kubernetes.io/projected/825acf66-470e-434c-8ec3-8a53fcd6e8f6-kube-api-access-tknpc\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:16:50.446260 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:50.446228 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:50.448424 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:16:50.448396 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-lm88z\" is forbidden: User \"system:node:ip-10-0-133-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-136.ec2.internal' and this object" podUID="825acf66-470e-434c-8ec3-8a53fcd6e8f6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:50.453951 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:16:50.453925 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-lm88z\" is forbidden: User \"system:node:ip-10-0-133-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-136.ec2.internal' and this object" podUID="825acf66-470e-434c-8ec3-8a53fcd6e8f6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:51.278966 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:16:51.278924 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-lm88z\" is forbidden: User \"system:node:ip-10-0-133-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-136.ec2.internal' and this object" podUID="825acf66-470e-434c-8ec3-8a53fcd6e8f6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lm88z" Jul 13 21:16:51.280456 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:51.280431 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="825acf66-470e-434c-8ec3-8a53fcd6e8f6" path="/var/lib/kubelet/pods/825acf66-470e-434c-8ec3-8a53fcd6e8f6/volumes" Jul 13 21:16:53.461646 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:53.461608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" event={"ID":"2c49620b-8006-4ce8-9aac-8f38d675ae77","Type":"ContainerStarted","Data":"1e1671e95544ec4155e2b96ef30945b59c249f717a796e367f8f730f21eb8125"} Jul 13 21:16:53.462127 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:53.461680 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" Jul 13 21:16:53.486150 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:16:53.486105 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" podStartSLOduration=13.677725234 podStartE2EDuration="20.486091545s" totalImagesPullingTime="6.808366311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:16:53.484847369 +0000 UTC m=+452.817511810" watchObservedRunningTime="2026-07-13 21:16:53.486091545 +0000 UTC m=+452.818755963" Jul 13 21:17:04.468794 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:04.468761 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" Jul 13 21:17:17.146007 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.145971 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd"] Jul 13 21:17:17.146491 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.146232 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" podUID="2c49620b-8006-4ce8-9aac-8f38d675ae77" containerName="manager" containerID="cri-o://1e1671e95544ec4155e2b96ef30945b59c249f717a796e367f8f730f21eb8125" gracePeriod=10 Jul 13 21:17:17.391952 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.391928 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" Jul 13 21:17:17.530535 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.530500 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c49620b-8006-4ce8-9aac-8f38d675ae77-extensions-socket-volume\") pod \"2c49620b-8006-4ce8-9aac-8f38d675ae77\" (UID: \"2c49620b-8006-4ce8-9aac-8f38d675ae77\") " Jul 13 21:17:17.530710 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.530572 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vpnl\" (UniqueName: \"kubernetes.io/projected/2c49620b-8006-4ce8-9aac-8f38d675ae77-kube-api-access-7vpnl\") pod \"2c49620b-8006-4ce8-9aac-8f38d675ae77\" (UID: \"2c49620b-8006-4ce8-9aac-8f38d675ae77\") " Jul 13 21:17:17.531020 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.530996 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c49620b-8006-4ce8-9aac-8f38d675ae77-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2c49620b-8006-4ce8-9aac-8f38d675ae77" (UID: "2c49620b-8006-4ce8-9aac-8f38d675ae77"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:17:17.532772 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.532752 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c49620b-8006-4ce8-9aac-8f38d675ae77-kube-api-access-7vpnl" (OuterVolumeSpecName: "kube-api-access-7vpnl") pod "2c49620b-8006-4ce8-9aac-8f38d675ae77" (UID: "2c49620b-8006-4ce8-9aac-8f38d675ae77"). InnerVolumeSpecName "kube-api-access-7vpnl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:17:17.565792 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.565759 2576 generic.go:356] "Generic (PLEG): container finished" podID="2c49620b-8006-4ce8-9aac-8f38d675ae77" containerID="1e1671e95544ec4155e2b96ef30945b59c249f717a796e367f8f730f21eb8125" exitCode=0 Jul 13 21:17:17.565983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.565801 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" Jul 13 21:17:17.565983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.565822 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" event={"ID":"2c49620b-8006-4ce8-9aac-8f38d675ae77","Type":"ContainerDied","Data":"1e1671e95544ec4155e2b96ef30945b59c249f717a796e367f8f730f21eb8125"} Jul 13 21:17:17.565983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.565892 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd" event={"ID":"2c49620b-8006-4ce8-9aac-8f38d675ae77","Type":"ContainerDied","Data":"cb3c39fb32a05b971a002f523545e5c726e30100865a909ad2731c0ef8bc4e12"} Jul 13 21:17:17.565983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.565923 2576 scope.go:117] "RemoveContainer" containerID="1e1671e95544ec4155e2b96ef30945b59c249f717a796e367f8f730f21eb8125" Jul 13 21:17:17.579433 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.579412 2576 scope.go:117] "RemoveContainer" containerID="1e1671e95544ec4155e2b96ef30945b59c249f717a796e367f8f730f21eb8125" Jul 13 21:17:17.579753 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:17:17.579735 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e1671e95544ec4155e2b96ef30945b59c249f717a796e367f8f730f21eb8125\": container with ID starting with 1e1671e95544ec4155e2b96ef30945b59c249f717a796e367f8f730f21eb8125 not found: ID does not exist" containerID="1e1671e95544ec4155e2b96ef30945b59c249f717a796e367f8f730f21eb8125" Jul 13 21:17:17.579795 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.579762 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e1671e95544ec4155e2b96ef30945b59c249f717a796e367f8f730f21eb8125"} err="failed to get container status \"1e1671e95544ec4155e2b96ef30945b59c249f717a796e367f8f730f21eb8125\": rpc error: code = NotFound desc = could not find container \"1e1671e95544ec4155e2b96ef30945b59c249f717a796e367f8f730f21eb8125\": container with ID starting with 1e1671e95544ec4155e2b96ef30945b59c249f717a796e367f8f730f21eb8125 not found: ID does not exist" Jul 13 21:17:17.589346 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.589320 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd"] Jul 13 21:17:17.593055 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.593024 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ktmvd"] Jul 13 21:17:17.631963 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.631929 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c49620b-8006-4ce8-9aac-8f38d675ae77-extensions-socket-volume\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:17:17.631963 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:17.631959 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vpnl\" (UniqueName: \"kubernetes.io/projected/2c49620b-8006-4ce8-9aac-8f38d675ae77-kube-api-access-7vpnl\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:17:19.280025 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:19.279986 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c49620b-8006-4ce8-9aac-8f38d675ae77" path="/var/lib/kubelet/pods/2c49620b-8006-4ce8-9aac-8f38d675ae77/volumes" Jul 13 21:17:24.545770 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.545732 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-flklc"] Jul 13 21:17:24.546184 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.546112 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c49620b-8006-4ce8-9aac-8f38d675ae77" containerName="manager" Jul 13 21:17:24.546184 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.546126 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c49620b-8006-4ce8-9aac-8f38d675ae77" containerName="manager" Jul 13 21:17:24.546184 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.546184 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c49620b-8006-4ce8-9aac-8f38d675ae77" containerName="manager" Jul 13 21:17:24.550226 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.550206 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" Jul 13 21:17:24.552512 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.552488 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 13 21:17:24.556441 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.556418 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-flklc"] Jul 13 21:17:24.642357 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.642327 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-flklc"] Jul 13 21:17:24.696614 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.696575 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mtwc\" (UniqueName: \"kubernetes.io/projected/d064bb32-9ff5-42dc-affb-a72252b9aaa4-kube-api-access-5mtwc\") pod \"limitador-limitador-64c94fd64f-flklc\" (UID: \"d064bb32-9ff5-42dc-affb-a72252b9aaa4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" Jul 13 21:17:24.696759 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.696677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d064bb32-9ff5-42dc-affb-a72252b9aaa4-config-file\") pod \"limitador-limitador-64c94fd64f-flklc\" (UID: \"d064bb32-9ff5-42dc-affb-a72252b9aaa4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" Jul 13 21:17:24.798122 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.798013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mtwc\" (UniqueName: \"kubernetes.io/projected/d064bb32-9ff5-42dc-affb-a72252b9aaa4-kube-api-access-5mtwc\") pod \"limitador-limitador-64c94fd64f-flklc\" (UID: \"d064bb32-9ff5-42dc-affb-a72252b9aaa4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" Jul 13 21:17:24.798290 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.798127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d064bb32-9ff5-42dc-affb-a72252b9aaa4-config-file\") pod \"limitador-limitador-64c94fd64f-flklc\" (UID: \"d064bb32-9ff5-42dc-affb-a72252b9aaa4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" Jul 13 21:17:24.798717 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.798698 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d064bb32-9ff5-42dc-affb-a72252b9aaa4-config-file\") pod \"limitador-limitador-64c94fd64f-flklc\" (UID: \"d064bb32-9ff5-42dc-affb-a72252b9aaa4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" Jul 13 21:17:24.806409 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.806381 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mtwc\" (UniqueName: \"kubernetes.io/projected/d064bb32-9ff5-42dc-affb-a72252b9aaa4-kube-api-access-5mtwc\") pod \"limitador-limitador-64c94fd64f-flklc\" (UID: \"d064bb32-9ff5-42dc-affb-a72252b9aaa4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" Jul 13 21:17:24.861203 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.861169 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" Jul 13 21:17:24.990014 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:24.989988 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-flklc"] Jul 13 21:17:24.992219 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:17:24.992185 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd064bb32_9ff5_42dc_affb_a72252b9aaa4.slice/crio-0bb15af0374999864e96c681990ee9559d0d20f291f3bdb34afdac1c938fb70d WatchSource:0}: Error finding container 0bb15af0374999864e96c681990ee9559d0d20f291f3bdb34afdac1c938fb70d: Status 404 returned error can't find the container with id 0bb15af0374999864e96c681990ee9559d0d20f291f3bdb34afdac1c938fb70d Jul 13 21:17:25.339010 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.338980 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6q2h9"] Jul 13 21:17:25.342150 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.342125 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6q2h9" Jul 13 21:17:25.344387 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.344363 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4j6tq\"" Jul 13 21:17:25.347905 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.347883 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6q2h9"] Jul 13 21:17:25.504714 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.504676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq7h6\" (UniqueName: \"kubernetes.io/projected/71ecdf0d-1eea-4a6c-a9bb-75a7accb120f-kube-api-access-jq7h6\") pod \"authorino-58cd955675-6q2h9\" (UID: \"71ecdf0d-1eea-4a6c-a9bb-75a7accb120f\") " pod="kuadrant-system/authorino-58cd955675-6q2h9" Jul 13 21:17:25.521987 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.521957 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ck8n"] Jul 13 21:17:25.524463 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.524448 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6ck8n" Jul 13 21:17:25.531651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.531625 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ck8n"] Jul 13 21:17:25.602883 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.602782 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" event={"ID":"d064bb32-9ff5-42dc-affb-a72252b9aaa4","Type":"ContainerStarted","Data":"0bb15af0374999864e96c681990ee9559d0d20f291f3bdb34afdac1c938fb70d"} Jul 13 21:17:25.605274 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.605222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msrjr\" (UniqueName: \"kubernetes.io/projected/8a99e990-292a-4b52-96ab-70dec7c97826-kube-api-access-msrjr\") pod \"authorino-75d556bd77-6ck8n\" (UID: \"8a99e990-292a-4b52-96ab-70dec7c97826\") " pod="kuadrant-system/authorino-75d556bd77-6ck8n" Jul 13 21:17:25.605416 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.605284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq7h6\" (UniqueName: \"kubernetes.io/projected/71ecdf0d-1eea-4a6c-a9bb-75a7accb120f-kube-api-access-jq7h6\") pod \"authorino-58cd955675-6q2h9\" (UID: \"71ecdf0d-1eea-4a6c-a9bb-75a7accb120f\") " pod="kuadrant-system/authorino-58cd955675-6q2h9" Jul 13 21:17:25.613438 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.613411 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq7h6\" (UniqueName: \"kubernetes.io/projected/71ecdf0d-1eea-4a6c-a9bb-75a7accb120f-kube-api-access-jq7h6\") pod \"authorino-58cd955675-6q2h9\" (UID: \"71ecdf0d-1eea-4a6c-a9bb-75a7accb120f\") " pod="kuadrant-system/authorino-58cd955675-6q2h9" Jul 13 21:17:25.653015 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.652982 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6q2h9" Jul 13 21:17:25.707142 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.707007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msrjr\" (UniqueName: \"kubernetes.io/projected/8a99e990-292a-4b52-96ab-70dec7c97826-kube-api-access-msrjr\") pod \"authorino-75d556bd77-6ck8n\" (UID: \"8a99e990-292a-4b52-96ab-70dec7c97826\") " pod="kuadrant-system/authorino-75d556bd77-6ck8n" Jul 13 21:17:25.715974 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.715945 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msrjr\" (UniqueName: \"kubernetes.io/projected/8a99e990-292a-4b52-96ab-70dec7c97826-kube-api-access-msrjr\") pod \"authorino-75d556bd77-6ck8n\" (UID: \"8a99e990-292a-4b52-96ab-70dec7c97826\") " pod="kuadrant-system/authorino-75d556bd77-6ck8n" Jul 13 21:17:25.802579 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.802516 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6q2h9"] Jul 13 21:17:25.805800 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:17:25.805766 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71ecdf0d_1eea_4a6c_a9bb_75a7accb120f.slice/crio-13693938fa44f7d9cd25792674d3f7d7912f060c6198b35cc0efb90672100ab6 WatchSource:0}: Error finding container 13693938fa44f7d9cd25792674d3f7d7912f060c6198b35cc0efb90672100ab6: Status 404 returned error can't find the container with id 13693938fa44f7d9cd25792674d3f7d7912f060c6198b35cc0efb90672100ab6 Jul 13 21:17:25.834746 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.834720 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6ck8n" Jul 13 21:17:25.993493 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:25.993453 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ck8n"] Jul 13 21:17:25.998037 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:17:25.998004 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a99e990_292a_4b52_96ab_70dec7c97826.slice/crio-77898ec77f36ce8dadf5e1c2eae60cad6a168be9279277ec658b0f223dbe5e23 WatchSource:0}: Error finding container 77898ec77f36ce8dadf5e1c2eae60cad6a168be9279277ec658b0f223dbe5e23: Status 404 returned error can't find the container with id 77898ec77f36ce8dadf5e1c2eae60cad6a168be9279277ec658b0f223dbe5e23 Jul 13 21:17:26.613811 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:26.613763 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6ck8n" event={"ID":"8a99e990-292a-4b52-96ab-70dec7c97826","Type":"ContainerStarted","Data":"77898ec77f36ce8dadf5e1c2eae60cad6a168be9279277ec658b0f223dbe5e23"} Jul 13 21:17:26.616064 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:26.616030 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6q2h9" event={"ID":"71ecdf0d-1eea-4a6c-a9bb-75a7accb120f","Type":"ContainerStarted","Data":"13693938fa44f7d9cd25792674d3f7d7912f060c6198b35cc0efb90672100ab6"} Jul 13 21:17:30.638927 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:30.638841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" event={"ID":"d064bb32-9ff5-42dc-affb-a72252b9aaa4","Type":"ContainerStarted","Data":"9f478a0acfcc6a4255547854e600ea860dcae8d8417786dbb77cec37d5916c4f"} Jul 13 21:17:30.638927 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:30.638940 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" Jul 13 21:17:30.640214 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:30.640188 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6q2h9" event={"ID":"71ecdf0d-1eea-4a6c-a9bb-75a7accb120f","Type":"ContainerStarted","Data":"d624aa0ba79b0b1913ea7e8736f47609c123d1a96ea17d82627e596f9242edeb"} Jul 13 21:17:30.641386 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:30.641366 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6ck8n" event={"ID":"8a99e990-292a-4b52-96ab-70dec7c97826","Type":"ContainerStarted","Data":"897d6056cfcf6caa33217bd3ad7273b200109160e4cdcd7f746bc02a4f2e27ef"} Jul 13 21:17:30.657172 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:30.657136 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" podStartSLOduration=1.432785999 podStartE2EDuration="6.657124173s" totalImagesPullingTime="5.224338174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:17:30.655710552 +0000 UTC m=+489.988374992" watchObservedRunningTime="2026-07-13 21:17:30.657124173 +0000 UTC m=+489.989788614" Jul 13 21:17:30.670441 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:30.670402 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6q2h9" podStartSLOduration=1.267291365 podStartE2EDuration="5.670388926s" totalImagesPullingTime="4.403097561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:17:30.66996635 +0000 UTC m=+490.002630792" watchObservedRunningTime="2026-07-13 21:17:30.670388926 +0000 UTC m=+490.003053367" Jul 13 21:17:30.684391 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:30.684349 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-6ck8n" podStartSLOduration=1.474008548 podStartE2EDuration="5.684334874s" totalImagesPullingTime="4.210326326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:17:30.68348392 +0000 UTC m=+490.016148362" watchObservedRunningTime="2026-07-13 21:17:30.684334874 +0000 UTC m=+490.016999317" Jul 13 21:17:30.705819 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:30.705792 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6q2h9"] Jul 13 21:17:32.650056 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:32.650011 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6q2h9" podUID="71ecdf0d-1eea-4a6c-a9bb-75a7accb120f" containerName="authorino" containerID="cri-o://d624aa0ba79b0b1913ea7e8736f47609c123d1a96ea17d82627e596f9242edeb" gracePeriod=30 Jul 13 21:17:32.902841 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:32.902778 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6q2h9" Jul 13 21:17:33.078826 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:33.078794 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq7h6\" (UniqueName: \"kubernetes.io/projected/71ecdf0d-1eea-4a6c-a9bb-75a7accb120f-kube-api-access-jq7h6\") pod \"71ecdf0d-1eea-4a6c-a9bb-75a7accb120f\" (UID: \"71ecdf0d-1eea-4a6c-a9bb-75a7accb120f\") " Jul 13 21:17:33.080822 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:33.080789 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ecdf0d-1eea-4a6c-a9bb-75a7accb120f-kube-api-access-jq7h6" (OuterVolumeSpecName: "kube-api-access-jq7h6") pod "71ecdf0d-1eea-4a6c-a9bb-75a7accb120f" (UID: "71ecdf0d-1eea-4a6c-a9bb-75a7accb120f"). InnerVolumeSpecName "kube-api-access-jq7h6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:17:33.179561 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:33.179477 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq7h6\" (UniqueName: \"kubernetes.io/projected/71ecdf0d-1eea-4a6c-a9bb-75a7accb120f-kube-api-access-jq7h6\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:17:33.655455 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:33.655418 2576 generic.go:356] "Generic (PLEG): container finished" podID="71ecdf0d-1eea-4a6c-a9bb-75a7accb120f" containerID="d624aa0ba79b0b1913ea7e8736f47609c123d1a96ea17d82627e596f9242edeb" exitCode=0 Jul 13 21:17:33.655905 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:33.655482 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6q2h9" event={"ID":"71ecdf0d-1eea-4a6c-a9bb-75a7accb120f","Type":"ContainerDied","Data":"d624aa0ba79b0b1913ea7e8736f47609c123d1a96ea17d82627e596f9242edeb"} Jul 13 21:17:33.655905 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:33.655488 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6q2h9" Jul 13 21:17:33.655905 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:33.655521 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6q2h9" event={"ID":"71ecdf0d-1eea-4a6c-a9bb-75a7accb120f","Type":"ContainerDied","Data":"13693938fa44f7d9cd25792674d3f7d7912f060c6198b35cc0efb90672100ab6"} Jul 13 21:17:33.655905 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:33.655543 2576 scope.go:117] "RemoveContainer" containerID="d624aa0ba79b0b1913ea7e8736f47609c123d1a96ea17d82627e596f9242edeb" Jul 13 21:17:33.664229 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:33.664206 2576 scope.go:117] "RemoveContainer" containerID="d624aa0ba79b0b1913ea7e8736f47609c123d1a96ea17d82627e596f9242edeb" Jul 13 21:17:33.664476 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:17:33.664459 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d624aa0ba79b0b1913ea7e8736f47609c123d1a96ea17d82627e596f9242edeb\": container with ID starting with d624aa0ba79b0b1913ea7e8736f47609c123d1a96ea17d82627e596f9242edeb not found: ID does not exist" containerID="d624aa0ba79b0b1913ea7e8736f47609c123d1a96ea17d82627e596f9242edeb" Jul 13 21:17:33.664523 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:33.664483 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d624aa0ba79b0b1913ea7e8736f47609c123d1a96ea17d82627e596f9242edeb"} err="failed to get container status \"d624aa0ba79b0b1913ea7e8736f47609c123d1a96ea17d82627e596f9242edeb\": rpc error: code = NotFound desc = could not find container \"d624aa0ba79b0b1913ea7e8736f47609c123d1a96ea17d82627e596f9242edeb\": container with ID starting with d624aa0ba79b0b1913ea7e8736f47609c123d1a96ea17d82627e596f9242edeb not found: ID does not exist" Jul 13 21:17:33.670484 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:33.670458 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6q2h9"] Jul 13 21:17:33.674038 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:33.674017 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6q2h9"] Jul 13 21:17:35.279932 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:35.279901 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71ecdf0d-1eea-4a6c-a9bb-75a7accb120f" path="/var/lib/kubelet/pods/71ecdf0d-1eea-4a6c-a9bb-75a7accb120f/volumes" Jul 13 21:17:39.278770 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:39.278742 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-flklc"] Jul 13 21:17:39.279349 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:39.278944 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" podUID="d064bb32-9ff5-42dc-affb-a72252b9aaa4" containerName="limitador" containerID="cri-o://9f478a0acfcc6a4255547854e600ea860dcae8d8417786dbb77cec37d5916c4f" gracePeriod=30 Jul 13 21:17:39.281147 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:39.281124 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" Jul 13 21:17:39.815935 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:39.815913 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" Jul 13 21:17:39.834363 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:39.834326 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mtwc\" (UniqueName: \"kubernetes.io/projected/d064bb32-9ff5-42dc-affb-a72252b9aaa4-kube-api-access-5mtwc\") pod \"d064bb32-9ff5-42dc-affb-a72252b9aaa4\" (UID: \"d064bb32-9ff5-42dc-affb-a72252b9aaa4\") " Jul 13 21:17:39.836682 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:39.836607 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d064bb32-9ff5-42dc-affb-a72252b9aaa4-kube-api-access-5mtwc" (OuterVolumeSpecName: "kube-api-access-5mtwc") pod "d064bb32-9ff5-42dc-affb-a72252b9aaa4" (UID: "d064bb32-9ff5-42dc-affb-a72252b9aaa4"). InnerVolumeSpecName "kube-api-access-5mtwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:17:39.934973 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:39.934943 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d064bb32-9ff5-42dc-affb-a72252b9aaa4-config-file\") pod \"d064bb32-9ff5-42dc-affb-a72252b9aaa4\" (UID: \"d064bb32-9ff5-42dc-affb-a72252b9aaa4\") " Jul 13 21:17:39.935150 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:39.935118 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mtwc\" (UniqueName: \"kubernetes.io/projected/d064bb32-9ff5-42dc-affb-a72252b9aaa4-kube-api-access-5mtwc\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:17:39.935304 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:39.935279 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d064bb32-9ff5-42dc-affb-a72252b9aaa4-config-file" (OuterVolumeSpecName: "config-file") pod "d064bb32-9ff5-42dc-affb-a72252b9aaa4" (UID: "d064bb32-9ff5-42dc-affb-a72252b9aaa4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:17:40.035551 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:40.035514 2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d064bb32-9ff5-42dc-affb-a72252b9aaa4-config-file\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:17:40.693025 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:40.692993 2576 generic.go:356] "Generic (PLEG): container finished" podID="d064bb32-9ff5-42dc-affb-a72252b9aaa4" containerID="9f478a0acfcc6a4255547854e600ea860dcae8d8417786dbb77cec37d5916c4f" exitCode=0 Jul 13 21:17:40.693531 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:40.693056 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" event={"ID":"d064bb32-9ff5-42dc-affb-a72252b9aaa4","Type":"ContainerDied","Data":"9f478a0acfcc6a4255547854e600ea860dcae8d8417786dbb77cec37d5916c4f"} Jul 13 21:17:40.693531 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:40.693120 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" event={"ID":"d064bb32-9ff5-42dc-affb-a72252b9aaa4","Type":"ContainerDied","Data":"0bb15af0374999864e96c681990ee9559d0d20f291f3bdb34afdac1c938fb70d"} Jul 13 21:17:40.693531 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:40.693056 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-flklc" Jul 13 21:17:40.693531 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:40.693144 2576 scope.go:117] "RemoveContainer" containerID="9f478a0acfcc6a4255547854e600ea860dcae8d8417786dbb77cec37d5916c4f" Jul 13 21:17:40.701699 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:40.701684 2576 scope.go:117] "RemoveContainer" containerID="9f478a0acfcc6a4255547854e600ea860dcae8d8417786dbb77cec37d5916c4f" Jul 13 21:17:40.702011 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:17:40.701990 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f478a0acfcc6a4255547854e600ea860dcae8d8417786dbb77cec37d5916c4f\": container with ID starting with 9f478a0acfcc6a4255547854e600ea860dcae8d8417786dbb77cec37d5916c4f not found: ID does not exist" containerID="9f478a0acfcc6a4255547854e600ea860dcae8d8417786dbb77cec37d5916c4f" Jul 13 21:17:40.702075 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:40.702020 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f478a0acfcc6a4255547854e600ea860dcae8d8417786dbb77cec37d5916c4f"} err="failed to get container status \"9f478a0acfcc6a4255547854e600ea860dcae8d8417786dbb77cec37d5916c4f\": rpc error: code = NotFound desc = could not find container \"9f478a0acfcc6a4255547854e600ea860dcae8d8417786dbb77cec37d5916c4f\": container with ID starting with 9f478a0acfcc6a4255547854e600ea860dcae8d8417786dbb77cec37d5916c4f not found: ID does not exist" Jul 13 21:17:40.714632 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:40.714606 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-flklc"] Jul 13 21:17:40.720247 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:40.720221 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-flklc"] Jul 13 21:17:41.280402 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:41.280366 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d064bb32-9ff5-42dc-affb-a72252b9aaa4" path="/var/lib/kubelet/pods/d064bb32-9ff5-42dc-affb-a72252b9aaa4/volumes" Jul 13 21:17:44.730200 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.730167 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj"] Jul 13 21:17:44.730666 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.730649 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d064bb32-9ff5-42dc-affb-a72252b9aaa4" containerName="limitador" Jul 13 21:17:44.730733 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.730668 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d064bb32-9ff5-42dc-affb-a72252b9aaa4" containerName="limitador" Jul 13 21:17:44.730733 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.730690 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ecdf0d-1eea-4a6c-a9bb-75a7accb120f" containerName="authorino" Jul 13 21:17:44.730733 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.730699 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ecdf0d-1eea-4a6c-a9bb-75a7accb120f" containerName="authorino" Jul 13 21:17:44.730894 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.730777 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ecdf0d-1eea-4a6c-a9bb-75a7accb120f" containerName="authorino" Jul 13 21:17:44.730894 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.730792 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d064bb32-9ff5-42dc-affb-a72252b9aaa4" containerName="limitador" Jul 13 21:17:44.733890 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.733870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj" Jul 13 21:17:44.736315 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.736295 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 13 21:17:44.737424 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.737400 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 13 21:17:44.737536 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.737453 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-mfjvr\"" Jul 13 21:17:44.737536 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.737473 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 13 21:17:44.740398 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.740373 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj"] Jul 13 21:17:44.773237 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.773212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2efb5736-31f3-4b42-82c2-3da5cd4a958b-data\") pod \"postgres-69fb4594cf-r4bfj\" (UID: \"2efb5736-31f3-4b42-82c2-3da5cd4a958b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj" Jul 13 21:17:44.773387 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.773253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlshc\" (UniqueName: \"kubernetes.io/projected/2efb5736-31f3-4b42-82c2-3da5cd4a958b-kube-api-access-nlshc\") pod \"postgres-69fb4594cf-r4bfj\" (UID: \"2efb5736-31f3-4b42-82c2-3da5cd4a958b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj" Jul 13 21:17:44.873981 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.873952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2efb5736-31f3-4b42-82c2-3da5cd4a958b-data\") pod \"postgres-69fb4594cf-r4bfj\" (UID: \"2efb5736-31f3-4b42-82c2-3da5cd4a958b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj" Jul 13 21:17:44.874140 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.873991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlshc\" (UniqueName: \"kubernetes.io/projected/2efb5736-31f3-4b42-82c2-3da5cd4a958b-kube-api-access-nlshc\") pod \"postgres-69fb4594cf-r4bfj\" (UID: \"2efb5736-31f3-4b42-82c2-3da5cd4a958b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj" Jul 13 21:17:44.874372 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.874352 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2efb5736-31f3-4b42-82c2-3da5cd4a958b-data\") pod \"postgres-69fb4594cf-r4bfj\" (UID: \"2efb5736-31f3-4b42-82c2-3da5cd4a958b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj" Jul 13 21:17:44.881469 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:44.881442 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlshc\" (UniqueName: \"kubernetes.io/projected/2efb5736-31f3-4b42-82c2-3da5cd4a958b-kube-api-access-nlshc\") pod \"postgres-69fb4594cf-r4bfj\" (UID: \"2efb5736-31f3-4b42-82c2-3da5cd4a958b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj" Jul 13 21:17:45.045651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:45.045562 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj" Jul 13 21:17:45.185118 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:45.185088 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj"] Jul 13 21:17:45.188052 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:17:45.188023 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2efb5736_31f3_4b42_82c2_3da5cd4a958b.slice/crio-029030414ee8f28ec2a7308167e6dc37a2703a1691c4b964f62d3f0e0f61ce1d WatchSource:0}: Error finding container 029030414ee8f28ec2a7308167e6dc37a2703a1691c4b964f62d3f0e0f61ce1d: Status 404 returned error can't find the container with id 029030414ee8f28ec2a7308167e6dc37a2703a1691c4b964f62d3f0e0f61ce1d Jul 13 21:17:45.722683 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:45.722645 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj" event={"ID":"2efb5736-31f3-4b42-82c2-3da5cd4a958b","Type":"ContainerStarted","Data":"029030414ee8f28ec2a7308167e6dc37a2703a1691c4b964f62d3f0e0f61ce1d"} Jul 13 21:17:50.754037 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:50.753999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj" event={"ID":"2efb5736-31f3-4b42-82c2-3da5cd4a958b","Type":"ContainerStarted","Data":"ee169c39ac766862ef9d39585bfa3bb4b012c8db1f7e7ef9f75bd01c380001c9"} Jul 13 21:17:50.754595 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:50.754071 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj" Jul 13 21:17:50.770020 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:50.769972 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj" podStartSLOduration=1.748050617 podStartE2EDuration="6.769958145s" totalImagesPullingTime="5.021907528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:17:50.768517062 +0000 UTC m=+510.101181504" watchObservedRunningTime="2026-07-13 21:17:50.769958145 +0000 UTC m=+510.102622588" Jul 13 21:17:56.787956 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:56.787922 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bfj" Jul 13 21:17:57.297545 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.297510 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bmvvx"] Jul 13 21:17:57.303579 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.303560 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bmvvx" Jul 13 21:17:57.307372 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.307339 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bmvvx"] Jul 13 21:17:57.387203 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.387158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nkbx\" (UniqueName: \"kubernetes.io/projected/eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f-kube-api-access-2nkbx\") pod \"authorino-5d4b67c446-bmvvx\" (UID: \"eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f\") " pod="kuadrant-system/authorino-5d4b67c446-bmvvx" Jul 13 21:17:57.488143 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.488106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nkbx\" (UniqueName: \"kubernetes.io/projected/eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f-kube-api-access-2nkbx\") pod \"authorino-5d4b67c446-bmvvx\" (UID: \"eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f\") " pod="kuadrant-system/authorino-5d4b67c446-bmvvx" Jul 13 21:17:57.497216 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.497182 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nkbx\" (UniqueName: \"kubernetes.io/projected/eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f-kube-api-access-2nkbx\") pod \"authorino-5d4b67c446-bmvvx\" (UID: \"eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f\") " pod="kuadrant-system/authorino-5d4b67c446-bmvvx" Jul 13 21:17:57.517799 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.517767 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bmvvx"] Jul 13 21:17:57.518055 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.518043 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bmvvx" Jul 13 21:17:57.540572 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.540545 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64dd78cf4f-4hsmc"] Jul 13 21:17:57.545877 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.545840 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64dd78cf4f-4hsmc" Jul 13 21:17:57.551608 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.551514 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64dd78cf4f-4hsmc"] Jul 13 21:17:57.589324 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.589292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhg2c\" (UniqueName: \"kubernetes.io/projected/b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949-kube-api-access-nhg2c\") pod \"authorino-64dd78cf4f-4hsmc\" (UID: \"b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949\") " pod="kuadrant-system/authorino-64dd78cf4f-4hsmc" Jul 13 21:17:57.614970 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.614938 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64dd78cf4f-4hsmc"] Jul 13 21:17:57.615221 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:17:57.615200 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-nhg2c], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-64dd78cf4f-4hsmc" podUID="b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949" Jul 13 21:17:57.641830 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.641800 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54944c7dc7-xlct9"] Jul 13 21:17:57.645703 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.645683 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54944c7dc7-xlct9" Jul 13 21:17:57.648204 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.648185 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 13 21:17:57.651903 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.651881 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bmvvx"] Jul 13 21:17:57.654642 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.654620 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54944c7dc7-xlct9"] Jul 13 21:17:57.654991 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:17:57.654968 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb66ecfc_1cc6_487a_8bc1_d7169a3d1c7f.slice/crio-937e455522fdac9b14eb19bdc06a781392e95cd666592eb15ed544d7f7c156c8 WatchSource:0}: Error finding container 937e455522fdac9b14eb19bdc06a781392e95cd666592eb15ed544d7f7c156c8: Status 404 returned error can't find the container with id 937e455522fdac9b14eb19bdc06a781392e95cd666592eb15ed544d7f7c156c8 Jul 13 21:17:57.690081 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.690048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f68wp\" (UniqueName: \"kubernetes.io/projected/4d7369ab-74fe-4d12-b104-b2b90504dec1-kube-api-access-f68wp\") pod \"authorino-54944c7dc7-xlct9\" (UID: \"4d7369ab-74fe-4d12-b104-b2b90504dec1\") " pod="kuadrant-system/authorino-54944c7dc7-xlct9" Jul 13 21:17:57.690081 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.690082 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d7369ab-74fe-4d12-b104-b2b90504dec1-tls-cert\") pod \"authorino-54944c7dc7-xlct9\" (UID: \"4d7369ab-74fe-4d12-b104-b2b90504dec1\") " pod="kuadrant-system/authorino-54944c7dc7-xlct9" Jul 13 21:17:57.690283 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.690177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhg2c\" (UniqueName: \"kubernetes.io/projected/b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949-kube-api-access-nhg2c\") pod \"authorino-64dd78cf4f-4hsmc\" (UID: \"b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949\") " pod="kuadrant-system/authorino-64dd78cf4f-4hsmc" Jul 13 21:17:57.698549 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.698526 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhg2c\" (UniqueName: \"kubernetes.io/projected/b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949-kube-api-access-nhg2c\") pod \"authorino-64dd78cf4f-4hsmc\" (UID: \"b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949\") " pod="kuadrant-system/authorino-64dd78cf4f-4hsmc" Jul 13 21:17:57.785565 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.785541 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64dd78cf4f-4hsmc" Jul 13 21:17:57.785565 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.785551 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bmvvx" event={"ID":"eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f","Type":"ContainerStarted","Data":"937e455522fdac9b14eb19bdc06a781392e95cd666592eb15ed544d7f7c156c8"} Jul 13 21:17:57.790583 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.790560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f68wp\" (UniqueName: \"kubernetes.io/projected/4d7369ab-74fe-4d12-b104-b2b90504dec1-kube-api-access-f68wp\") pod \"authorino-54944c7dc7-xlct9\" (UID: \"4d7369ab-74fe-4d12-b104-b2b90504dec1\") " pod="kuadrant-system/authorino-54944c7dc7-xlct9" Jul 13 21:17:57.790944 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.790591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d7369ab-74fe-4d12-b104-b2b90504dec1-tls-cert\") pod \"authorino-54944c7dc7-xlct9\" (UID: \"4d7369ab-74fe-4d12-b104-b2b90504dec1\") " pod="kuadrant-system/authorino-54944c7dc7-xlct9" Jul 13 21:17:57.793151 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.793123 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d7369ab-74fe-4d12-b104-b2b90504dec1-tls-cert\") pod \"authorino-54944c7dc7-xlct9\" (UID: \"4d7369ab-74fe-4d12-b104-b2b90504dec1\") " pod="kuadrant-system/authorino-54944c7dc7-xlct9" Jul 13 21:17:57.793151 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.793148 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64dd78cf4f-4hsmc" Jul 13 21:17:57.797971 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.797945 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f68wp\" (UniqueName: \"kubernetes.io/projected/4d7369ab-74fe-4d12-b104-b2b90504dec1-kube-api-access-f68wp\") pod \"authorino-54944c7dc7-xlct9\" (UID: \"4d7369ab-74fe-4d12-b104-b2b90504dec1\") " pod="kuadrant-system/authorino-54944c7dc7-xlct9" Jul 13 21:17:57.891107 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.891008 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhg2c\" (UniqueName: \"kubernetes.io/projected/b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949-kube-api-access-nhg2c\") pod \"b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949\" (UID: \"b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949\") " Jul 13 21:17:57.893043 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.893020 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949-kube-api-access-nhg2c" (OuterVolumeSpecName: "kube-api-access-nhg2c") pod "b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949" (UID: "b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949"). InnerVolumeSpecName "kube-api-access-nhg2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:17:57.964209 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.964175 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54944c7dc7-xlct9" Jul 13 21:17:57.992485 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:57.992452 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhg2c\" (UniqueName: \"kubernetes.io/projected/b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949-kube-api-access-nhg2c\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:17:58.096771 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:58.095290 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54944c7dc7-xlct9"] Jul 13 21:17:58.791832 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:58.791740 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bmvvx" event={"ID":"eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f","Type":"ContainerStarted","Data":"00a344d9600ddc205b16282b88e8ee034a445c9024832154c5f4dda4dfd150f3"} Jul 13 21:17:58.791832 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:58.791774 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-bmvvx" podUID="eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f" containerName="authorino" containerID="cri-o://00a344d9600ddc205b16282b88e8ee034a445c9024832154c5f4dda4dfd150f3" gracePeriod=30 Jul 13 21:17:58.793370 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:58.793344 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54944c7dc7-xlct9" event={"ID":"4d7369ab-74fe-4d12-b104-b2b90504dec1","Type":"ContainerStarted","Data":"ad823f31b4a6c44d60fefbbbe7da80a31ae2633b7c51d0cc61b11a50f21615ca"} Jul 13 21:17:58.793495 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:58.793387 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54944c7dc7-xlct9" event={"ID":"4d7369ab-74fe-4d12-b104-b2b90504dec1","Type":"ContainerStarted","Data":"94dce13bfcfdeb41a6cd0ec99de28e7c3a0964f344cd31c743cbe8b0ae147f7a"} Jul 13 21:17:58.793495 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:58.793450 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64dd78cf4f-4hsmc" Jul 13 21:17:58.807589 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:58.807549 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-bmvvx" podStartSLOduration=1.345743129 podStartE2EDuration="1.807533249s" totalImagesPullingTime="461.79012ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:17:58.805808812 +0000 UTC m=+518.138473254" watchObservedRunningTime="2026-07-13 21:17:58.807533249 +0000 UTC m=+518.140197690" Jul 13 21:17:58.821323 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:58.821281 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54944c7dc7-xlct9" podStartSLOduration=1.301368495 podStartE2EDuration="1.821265946s" totalImagesPullingTime="519.897451ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:17:58.819614911 +0000 UTC m=+518.152279353" watchObservedRunningTime="2026-07-13 21:17:58.821265946 +0000 UTC m=+518.153930387" Jul 13 21:17:58.846877 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:58.844887 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ck8n"] Jul 13 21:17:58.846877 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:58.845137 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-6ck8n" podUID="8a99e990-292a-4b52-96ab-70dec7c97826" containerName="authorino" containerID="cri-o://897d6056cfcf6caa33217bd3ad7273b200109160e4cdcd7f746bc02a4f2e27ef" gracePeriod=30 Jul 13 21:17:58.888742 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:58.888711 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64dd78cf4f-4hsmc"] Jul 13 21:17:58.892903 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:58.892874 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-64dd78cf4f-4hsmc"] Jul 13 21:17:59.108800 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.108773 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bmvvx" Jul 13 21:17:59.116430 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.116405 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6ck8n" Jul 13 21:17:59.206196 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.206164 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msrjr\" (UniqueName: \"kubernetes.io/projected/8a99e990-292a-4b52-96ab-70dec7c97826-kube-api-access-msrjr\") pod \"8a99e990-292a-4b52-96ab-70dec7c97826\" (UID: \"8a99e990-292a-4b52-96ab-70dec7c97826\") " Jul 13 21:17:59.206376 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.206216 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nkbx\" (UniqueName: \"kubernetes.io/projected/eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f-kube-api-access-2nkbx\") pod \"eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f\" (UID: \"eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f\") " Jul 13 21:17:59.208302 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.208272 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a99e990-292a-4b52-96ab-70dec7c97826-kube-api-access-msrjr" (OuterVolumeSpecName: "kube-api-access-msrjr") pod "8a99e990-292a-4b52-96ab-70dec7c97826" (UID: "8a99e990-292a-4b52-96ab-70dec7c97826"). InnerVolumeSpecName "kube-api-access-msrjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:17:59.208413 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.208310 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f-kube-api-access-2nkbx" (OuterVolumeSpecName: "kube-api-access-2nkbx") pod "eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f" (UID: "eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f"). InnerVolumeSpecName "kube-api-access-2nkbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:17:59.280444 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.280412 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949" path="/var/lib/kubelet/pods/b952e2c1-c7d4-4ab3-b5dd-ca26d83b5949/volumes" Jul 13 21:17:59.307391 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.307296 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msrjr\" (UniqueName: \"kubernetes.io/projected/8a99e990-292a-4b52-96ab-70dec7c97826-kube-api-access-msrjr\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:17:59.307391 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.307336 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nkbx\" (UniqueName: \"kubernetes.io/projected/eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f-kube-api-access-2nkbx\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:17:59.799187 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.799152 2576 generic.go:356] "Generic (PLEG): container finished" podID="8a99e990-292a-4b52-96ab-70dec7c97826" containerID="897d6056cfcf6caa33217bd3ad7273b200109160e4cdcd7f746bc02a4f2e27ef" exitCode=0 Jul 13 21:17:59.799631 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.799196 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6ck8n" Jul 13 21:17:59.799631 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.799243 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6ck8n" event={"ID":"8a99e990-292a-4b52-96ab-70dec7c97826","Type":"ContainerDied","Data":"897d6056cfcf6caa33217bd3ad7273b200109160e4cdcd7f746bc02a4f2e27ef"} Jul 13 21:17:59.799631 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.799289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6ck8n" event={"ID":"8a99e990-292a-4b52-96ab-70dec7c97826","Type":"ContainerDied","Data":"77898ec77f36ce8dadf5e1c2eae60cad6a168be9279277ec658b0f223dbe5e23"} Jul 13 21:17:59.799631 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.799309 2576 scope.go:117] "RemoveContainer" containerID="897d6056cfcf6caa33217bd3ad7273b200109160e4cdcd7f746bc02a4f2e27ef" Jul 13 21:17:59.800530 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.800485 2576 generic.go:356] "Generic (PLEG): container finished" podID="eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f" containerID="00a344d9600ddc205b16282b88e8ee034a445c9024832154c5f4dda4dfd150f3" exitCode=0 Jul 13 21:17:59.800589 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.800530 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bmvvx" Jul 13 21:17:59.800641 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.800515 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bmvvx" event={"ID":"eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f","Type":"ContainerDied","Data":"00a344d9600ddc205b16282b88e8ee034a445c9024832154c5f4dda4dfd150f3"} Jul 13 21:17:59.800690 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.800655 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bmvvx" event={"ID":"eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f","Type":"ContainerDied","Data":"937e455522fdac9b14eb19bdc06a781392e95cd666592eb15ed544d7f7c156c8"} Jul 13 21:17:59.807665 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.807650 2576 scope.go:117] "RemoveContainer" containerID="897d6056cfcf6caa33217bd3ad7273b200109160e4cdcd7f746bc02a4f2e27ef" Jul 13 21:17:59.807935 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:17:59.807918 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"897d6056cfcf6caa33217bd3ad7273b200109160e4cdcd7f746bc02a4f2e27ef\": container with ID starting with 897d6056cfcf6caa33217bd3ad7273b200109160e4cdcd7f746bc02a4f2e27ef not found: ID does not exist" containerID="897d6056cfcf6caa33217bd3ad7273b200109160e4cdcd7f746bc02a4f2e27ef" Jul 13 21:17:59.807988 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.807944 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"897d6056cfcf6caa33217bd3ad7273b200109160e4cdcd7f746bc02a4f2e27ef"} err="failed to get container status \"897d6056cfcf6caa33217bd3ad7273b200109160e4cdcd7f746bc02a4f2e27ef\": rpc error: code = NotFound desc = could not find container \"897d6056cfcf6caa33217bd3ad7273b200109160e4cdcd7f746bc02a4f2e27ef\": container with ID starting with 897d6056cfcf6caa33217bd3ad7273b200109160e4cdcd7f746bc02a4f2e27ef not found: ID does not exist" Jul 13 21:17:59.807988 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.807962 2576 scope.go:117] "RemoveContainer" containerID="00a344d9600ddc205b16282b88e8ee034a445c9024832154c5f4dda4dfd150f3" Jul 13 21:17:59.815453 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.815438 2576 scope.go:117] "RemoveContainer" containerID="00a344d9600ddc205b16282b88e8ee034a445c9024832154c5f4dda4dfd150f3" Jul 13 21:17:59.815714 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:17:59.815699 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00a344d9600ddc205b16282b88e8ee034a445c9024832154c5f4dda4dfd150f3\": container with ID starting with 00a344d9600ddc205b16282b88e8ee034a445c9024832154c5f4dda4dfd150f3 not found: ID does not exist" containerID="00a344d9600ddc205b16282b88e8ee034a445c9024832154c5f4dda4dfd150f3" Jul 13 21:17:59.815772 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.815721 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a344d9600ddc205b16282b88e8ee034a445c9024832154c5f4dda4dfd150f3"} err="failed to get container status \"00a344d9600ddc205b16282b88e8ee034a445c9024832154c5f4dda4dfd150f3\": rpc error: code = NotFound desc = could not find container \"00a344d9600ddc205b16282b88e8ee034a445c9024832154c5f4dda4dfd150f3\": container with ID starting with 00a344d9600ddc205b16282b88e8ee034a445c9024832154c5f4dda4dfd150f3 not found: ID does not exist" Jul 13 21:17:59.816589 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.816571 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ck8n"] Jul 13 21:17:59.820294 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.820275 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ck8n"] Jul 13 21:17:59.830339 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.830316 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bmvvx"] Jul 13 21:17:59.833506 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:17:59.833487 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bmvvx"] Jul 13 21:18:01.284729 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:01.284698 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a99e990-292a-4b52-96ab-70dec7c97826" path="/var/lib/kubelet/pods/8a99e990-292a-4b52-96ab-70dec7c97826/volumes" Jul 13 21:18:01.285195 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:01.285036 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f" path="/var/lib/kubelet/pods/eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f/volumes" Jul 13 21:18:40.747457 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.747421 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-h4f9d"] Jul 13 21:18:40.747944 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.747766 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a99e990-292a-4b52-96ab-70dec7c97826" containerName="authorino" Jul 13 21:18:40.747944 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.747778 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a99e990-292a-4b52-96ab-70dec7c97826" containerName="authorino" Jul 13 21:18:40.747944 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.747792 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f" containerName="authorino" Jul 13 21:18:40.747944 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.747798 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f" containerName="authorino" Jul 13 21:18:40.747944 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.747848 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb66ecfc-1cc6-487a-8bc1-d7169a3d1c7f" containerName="authorino" Jul 13 21:18:40.747944 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.747880 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a99e990-292a-4b52-96ab-70dec7c97826" containerName="authorino" Jul 13 21:18:40.752176 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.752160 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-h4f9d" Jul 13 21:18:40.761650 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.755780 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-chxw8\"" Jul 13 21:18:40.761650 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.755946 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 13 21:18:40.765288 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.765260 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-h4f9d"] Jul 13 21:18:40.863168 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.863130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7r79\" (UniqueName: \"kubernetes.io/projected/a165f8fb-3684-4e0e-8877-c186ac1c825a-kube-api-access-g7r79\") pod \"payload-processing-f9b8d9b9b-h4f9d\" (UID: \"a165f8fb-3684-4e0e-8877-c186ac1c825a\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-h4f9d" Jul 13 21:18:40.863336 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.863196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a165f8fb-3684-4e0e-8877-c186ac1c825a-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-h4f9d\" (UID: \"a165f8fb-3684-4e0e-8877-c186ac1c825a\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-h4f9d" Jul 13 21:18:40.963646 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.963606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a165f8fb-3684-4e0e-8877-c186ac1c825a-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-h4f9d\" (UID: \"a165f8fb-3684-4e0e-8877-c186ac1c825a\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-h4f9d" Jul 13 21:18:40.963822 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.963682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7r79\" (UniqueName: \"kubernetes.io/projected/a165f8fb-3684-4e0e-8877-c186ac1c825a-kube-api-access-g7r79\") pod \"payload-processing-f9b8d9b9b-h4f9d\" (UID: \"a165f8fb-3684-4e0e-8877-c186ac1c825a\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-h4f9d" Jul 13 21:18:40.964324 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.964302 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a165f8fb-3684-4e0e-8877-c186ac1c825a-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-h4f9d\" (UID: \"a165f8fb-3684-4e0e-8877-c186ac1c825a\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-h4f9d" Jul 13 21:18:40.972138 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:40.972110 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7r79\" (UniqueName: \"kubernetes.io/projected/a165f8fb-3684-4e0e-8877-c186ac1c825a-kube-api-access-g7r79\") pod \"payload-processing-f9b8d9b9b-h4f9d\" (UID: \"a165f8fb-3684-4e0e-8877-c186ac1c825a\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-h4f9d" Jul 13 21:18:41.067633 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:41.067550 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-h4f9d" Jul 13 21:18:41.198559 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:41.198535 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-h4f9d"] Jul 13 21:18:41.200679 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:18:41.200655 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda165f8fb_3684_4e0e_8877_c186ac1c825a.slice/crio-7cfa3fc93c974562c62a895f55bdb470287df15c723d863ec8e5852c4cad8ebc WatchSource:0}: Error finding container 7cfa3fc93c974562c62a895f55bdb470287df15c723d863ec8e5852c4cad8ebc: Status 404 returned error can't find the container with id 7cfa3fc93c974562c62a895f55bdb470287df15c723d863ec8e5852c4cad8ebc Jul 13 21:18:41.990228 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:41.990196 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-h4f9d" event={"ID":"a165f8fb-3684-4e0e-8877-c186ac1c825a","Type":"ContainerStarted","Data":"7cfa3fc93c974562c62a895f55bdb470287df15c723d863ec8e5852c4cad8ebc"} Jul 13 21:18:42.995308 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:42.995277 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-h4f9d" event={"ID":"a165f8fb-3684-4e0e-8877-c186ac1c825a","Type":"ContainerStarted","Data":"f0dafd55d5705b15585fe883f701b74050aacc8671cc9e31e48d9340aafafa06"} Jul 13 21:18:42.995721 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:42.995405 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-h4f9d" Jul 13 21:18:43.013543 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:43.013496 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-h4f9d" podStartSLOduration=1.68533422 podStartE2EDuration="3.013482744s" totalImagesPullingTime="1.328148524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:18:43.012015131 +0000 UTC m=+562.344679572" watchObservedRunningTime="2026-07-13 21:18:43.013482744 +0000 UTC m=+562.346147196" Jul 13 21:18:54.002421 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:18:54.002391 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-h4f9d" Jul 13 21:19:10.351725 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.351696 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj"] Jul 13 21:19:10.355233 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.355216 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.358507 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.358485 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8779s\"" Jul 13 21:19:10.358628 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.358520 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 21:19:10.358628 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.358558 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 13 21:19:10.358628 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.358495 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 21:19:10.367181 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.367156 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj"] Jul 13 21:19:10.519815 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.519780 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.519815 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.519819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.520062 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.519883 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.520062 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.519931 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.520062 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.519949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8qcf\" (UniqueName: \"kubernetes.io/projected/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-kube-api-access-v8qcf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.520062 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.520015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.621278 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.621182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.621278 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.621224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.621278 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.621266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.621530 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.621307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.621530 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.621329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8qcf\" (UniqueName: \"kubernetes.io/projected/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-kube-api-access-v8qcf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.621530 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.621371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.621650 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.621580 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.621850 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.621828 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.621983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.621948 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.623496 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.623473 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.624036 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.624015 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.628461 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.628439 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8qcf\" (UniqueName: \"kubernetes.io/projected/f7fe0b9a-bf52-487c-8ee2-96bd08e07798-kube-api-access-v8qcf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj\" (UID: \"f7fe0b9a-bf52-487c-8ee2-96bd08e07798\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.665577 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.665545 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:10.800972 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:10.800946 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj"] Jul 13 21:19:10.803366 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:19:10.803340 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7fe0b9a_bf52_487c_8ee2_96bd08e07798.slice/crio-35e60bcd33ef5ad733b289ad4773aab7eff0bbc1261ec6d48c5aac7d51e99412 WatchSource:0}: Error finding container 35e60bcd33ef5ad733b289ad4773aab7eff0bbc1261ec6d48c5aac7d51e99412: Status 404 returned error can't find the container with id 35e60bcd33ef5ad733b289ad4773aab7eff0bbc1261ec6d48c5aac7d51e99412 Jul 13 21:19:11.121048 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:11.121000 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" event={"ID":"f7fe0b9a-bf52-487c-8ee2-96bd08e07798","Type":"ContainerStarted","Data":"35e60bcd33ef5ad733b289ad4773aab7eff0bbc1261ec6d48c5aac7d51e99412"} Jul 13 21:19:12.127154 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:12.127121 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" event={"ID":"f7fe0b9a-bf52-487c-8ee2-96bd08e07798","Type":"ContainerStarted","Data":"e12e5f83b81380db34b5b4117db78028a336e2c0823c43ca2d5d87179e512bc6"} Jul 13 21:19:12.145819 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:12.145760 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" podStartSLOduration=0.952997275 podStartE2EDuration="2.145738243s" totalImagesPullingTime="1.192740968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:19:12.145315003 +0000 UTC m=+591.477979445" watchObservedRunningTime="2026-07-13 21:19:12.145738243 +0000 UTC m=+591.478402686" Jul 13 21:19:20.666719 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:20.666666 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:20.667202 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:20.666780 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:20.679189 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:20.679165 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:21.176013 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:21.175987 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj" Jul 13 21:19:42.262042 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.262007 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g"] Jul 13 21:19:42.264401 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.264386 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.266804 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.266786 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 13 21:19:42.280318 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.280298 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g"] Jul 13 21:19:42.404524 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.404492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/215e44a2-e3cb-45fe-9447-96d4cf353d44-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.404723 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.404561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/215e44a2-e3cb-45fe-9447-96d4cf353d44-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.404723 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.404598 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/215e44a2-e3cb-45fe-9447-96d4cf353d44-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.404723 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.404624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/215e44a2-e3cb-45fe-9447-96d4cf353d44-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.404723 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.404686 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f9wf\" (UniqueName: \"kubernetes.io/projected/215e44a2-e3cb-45fe-9447-96d4cf353d44-kube-api-access-6f9wf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.404923 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.404736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/215e44a2-e3cb-45fe-9447-96d4cf353d44-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.506143 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.506103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/215e44a2-e3cb-45fe-9447-96d4cf353d44-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.506143 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.506148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/215e44a2-e3cb-45fe-9447-96d4cf353d44-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.506353 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.506188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f9wf\" (UniqueName: \"kubernetes.io/projected/215e44a2-e3cb-45fe-9447-96d4cf353d44-kube-api-access-6f9wf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.506353 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.506227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/215e44a2-e3cb-45fe-9447-96d4cf353d44-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.506353 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.506250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/215e44a2-e3cb-45fe-9447-96d4cf353d44-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.506353 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.506311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/215e44a2-e3cb-45fe-9447-96d4cf353d44-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.506740 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.506707 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/215e44a2-e3cb-45fe-9447-96d4cf353d44-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.506740 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.506736 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/215e44a2-e3cb-45fe-9447-96d4cf353d44-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.506928 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.506799 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/215e44a2-e3cb-45fe-9447-96d4cf353d44-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.508398 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.508383 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/215e44a2-e3cb-45fe-9447-96d4cf353d44-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.508530 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.508513 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/215e44a2-e3cb-45fe-9447-96d4cf353d44-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.513754 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.513703 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f9wf\" (UniqueName: \"kubernetes.io/projected/215e44a2-e3cb-45fe-9447-96d4cf353d44-kube-api-access-6f9wf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lwg2g\" (UID: \"215e44a2-e3cb-45fe-9447-96d4cf353d44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.574568 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.574537 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:42.707701 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.707673 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g"] Jul 13 21:19:42.709502 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:19:42.709472 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215e44a2_e3cb_45fe_9447_96d4cf353d44.slice/crio-260b1298c9e873a37121ef70da3dbdfeb433939927d64793b0cfe4f5eeb82f18 WatchSource:0}: Error finding container 260b1298c9e873a37121ef70da3dbdfeb433939927d64793b0cfe4f5eeb82f18: Status 404 returned error can't find the container with id 260b1298c9e873a37121ef70da3dbdfeb433939927d64793b0cfe4f5eeb82f18 Jul 13 21:19:42.710775 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:42.710758 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 21:19:43.266973 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:43.266880 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" event={"ID":"215e44a2-e3cb-45fe-9447-96d4cf353d44","Type":"ContainerStarted","Data":"3f3c0e7cb44b4926349fd0e53df5ed5d0e629fa449231d1f40ebe5a04ee458ad"} Jul 13 21:19:43.266973 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:43.266934 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" event={"ID":"215e44a2-e3cb-45fe-9447-96d4cf353d44","Type":"ContainerStarted","Data":"260b1298c9e873a37121ef70da3dbdfeb433939927d64793b0cfe4f5eeb82f18"} Jul 13 21:19:43.286201 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:43.286152 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" podStartSLOduration=1.019644869 podStartE2EDuration="1.28613695s" totalImagesPullingTime="266.492081ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:19:43.284451944 +0000 UTC m=+622.617116389" watchObservedRunningTime="2026-07-13 21:19:43.28613695 +0000 UTC m=+622.618801392" Jul 13 21:19:52.575557 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:52.575522 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:52.576032 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:52.575579 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:52.588034 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:52.588009 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:19:53.321324 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:19:53.321298 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lwg2g" Jul 13 21:20:01.065476 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.065434 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5"] Jul 13 21:20:01.069151 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.069131 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.071423 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.071406 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 13 21:20:01.077254 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.077230 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5"] Jul 13 21:20:01.179749 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.179710 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56249e9f-1948-4ad8-903a-7c54ec1e74b9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.179749 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.179750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56249e9f-1948-4ad8-903a-7c54ec1e74b9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.179986 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.179812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np4cd\" (UniqueName: \"kubernetes.io/projected/56249e9f-1948-4ad8-903a-7c54ec1e74b9-kube-api-access-np4cd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.179986 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.179852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56249e9f-1948-4ad8-903a-7c54ec1e74b9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.179986 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.179918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56249e9f-1948-4ad8-903a-7c54ec1e74b9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.179986 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.179964 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56249e9f-1948-4ad8-903a-7c54ec1e74b9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.281373 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.281343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56249e9f-1948-4ad8-903a-7c54ec1e74b9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.281540 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.281392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56249e9f-1948-4ad8-903a-7c54ec1e74b9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.281540 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.281412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56249e9f-1948-4ad8-903a-7c54ec1e74b9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.281540 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.281442 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np4cd\" (UniqueName: \"kubernetes.io/projected/56249e9f-1948-4ad8-903a-7c54ec1e74b9-kube-api-access-np4cd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.281540 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.281459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56249e9f-1948-4ad8-903a-7c54ec1e74b9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.281540 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.281487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56249e9f-1948-4ad8-903a-7c54ec1e74b9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.281819 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.281795 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56249e9f-1948-4ad8-903a-7c54ec1e74b9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.281911 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.281830 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56249e9f-1948-4ad8-903a-7c54ec1e74b9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.281911 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.281847 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56249e9f-1948-4ad8-903a-7c54ec1e74b9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.283607 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.283585 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56249e9f-1948-4ad8-903a-7c54ec1e74b9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.284105 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.284084 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56249e9f-1948-4ad8-903a-7c54ec1e74b9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.290685 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.290661 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np4cd\" (UniqueName: \"kubernetes.io/projected/56249e9f-1948-4ad8-903a-7c54ec1e74b9-kube-api-access-np4cd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-49nd5\" (UID: \"56249e9f-1948-4ad8-903a-7c54ec1e74b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.380174 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.380092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:01.514434 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:01.514412 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5"] Jul 13 21:20:01.516510 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:20:01.516481 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56249e9f_1948_4ad8_903a_7c54ec1e74b9.slice/crio-43bbaddfdfc4937d1d46ca0638dd3b941f523655a52f873ce446e2992b9bc5d3 WatchSource:0}: Error finding container 43bbaddfdfc4937d1d46ca0638dd3b941f523655a52f873ce446e2992b9bc5d3: Status 404 returned error can't find the container with id 43bbaddfdfc4937d1d46ca0638dd3b941f523655a52f873ce446e2992b9bc5d3 Jul 13 21:20:02.354326 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:02.354291 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" event={"ID":"56249e9f-1948-4ad8-903a-7c54ec1e74b9","Type":"ContainerStarted","Data":"ad155c886a2755d5837204ebc9a847ba755385bffa49d9644b7ce58a604a818c"} Jul 13 21:20:02.354760 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:02.354339 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" event={"ID":"56249e9f-1948-4ad8-903a-7c54ec1e74b9","Type":"ContainerStarted","Data":"43bbaddfdfc4937d1d46ca0638dd3b941f523655a52f873ce446e2992b9bc5d3"} Jul 13 21:20:02.371977 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:02.371924 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" podStartSLOduration=1.1779083479999999 podStartE2EDuration="1.371908819s" totalImagesPullingTime="194.000471ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:20:02.369833431 +0000 UTC m=+641.702497871" watchObservedRunningTime="2026-07-13 21:20:02.371908819 +0000 UTC m=+641.704573260" Jul 13 21:20:11.381029 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:11.380998 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:11.381405 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:11.381084 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:11.394040 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:11.394018 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:20:11.409160 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:20:11.409132 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-49nd5" Jul 13 21:21:10.882870 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:10.882815 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7fcbf7c7b4-2w6qx"] Jul 13 21:21:10.887729 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:10.887701 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fcbf7c7b4-2w6qx" Jul 13 21:21:10.894299 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:10.894270 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fcbf7c7b4-2w6qx"] Jul 13 21:21:11.000618 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:11.000578 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxplj\" (UniqueName: \"kubernetes.io/projected/5c65adaf-c022-4517-8929-09084eb40f43-kube-api-access-gxplj\") pod \"authorino-7fcbf7c7b4-2w6qx\" (UID: \"5c65adaf-c022-4517-8929-09084eb40f43\") " pod="kuadrant-system/authorino-7fcbf7c7b4-2w6qx" Jul 13 21:21:11.000793 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:11.000693 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c65adaf-c022-4517-8929-09084eb40f43-tls-cert\") pod \"authorino-7fcbf7c7b4-2w6qx\" (UID: \"5c65adaf-c022-4517-8929-09084eb40f43\") " pod="kuadrant-system/authorino-7fcbf7c7b4-2w6qx" Jul 13 21:21:11.101651 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:11.101617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxplj\" (UniqueName: \"kubernetes.io/projected/5c65adaf-c022-4517-8929-09084eb40f43-kube-api-access-gxplj\") pod \"authorino-7fcbf7c7b4-2w6qx\" (UID: \"5c65adaf-c022-4517-8929-09084eb40f43\") " pod="kuadrant-system/authorino-7fcbf7c7b4-2w6qx" Jul 13 21:21:11.101820 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:11.101679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c65adaf-c022-4517-8929-09084eb40f43-tls-cert\") pod \"authorino-7fcbf7c7b4-2w6qx\" (UID: \"5c65adaf-c022-4517-8929-09084eb40f43\") " pod="kuadrant-system/authorino-7fcbf7c7b4-2w6qx" Jul 13 21:21:11.104093 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:11.104075 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c65adaf-c022-4517-8929-09084eb40f43-tls-cert\") pod \"authorino-7fcbf7c7b4-2w6qx\" (UID: \"5c65adaf-c022-4517-8929-09084eb40f43\") " pod="kuadrant-system/authorino-7fcbf7c7b4-2w6qx" Jul 13 21:21:11.109347 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:11.109323 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxplj\" (UniqueName: \"kubernetes.io/projected/5c65adaf-c022-4517-8929-09084eb40f43-kube-api-access-gxplj\") pod \"authorino-7fcbf7c7b4-2w6qx\" (UID: \"5c65adaf-c022-4517-8929-09084eb40f43\") " pod="kuadrant-system/authorino-7fcbf7c7b4-2w6qx" Jul 13 21:21:11.197093 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:11.197016 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fcbf7c7b4-2w6qx" Jul 13 21:21:11.331009 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:11.330983 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fcbf7c7b4-2w6qx"] Jul 13 21:21:11.332486 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:21:11.332460 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c65adaf_c022_4517_8929_09084eb40f43.slice/crio-300bc04c23e44b782be25854e15a6c8faa218848484e2ad4579bb83efc823e41 WatchSource:0}: Error finding container 300bc04c23e44b782be25854e15a6c8faa218848484e2ad4579bb83efc823e41: Status 404 returned error can't find the container with id 300bc04c23e44b782be25854e15a6c8faa218848484e2ad4579bb83efc823e41 Jul 13 21:21:11.669799 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:11.669764 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fcbf7c7b4-2w6qx" event={"ID":"5c65adaf-c022-4517-8929-09084eb40f43","Type":"ContainerStarted","Data":"300bc04c23e44b782be25854e15a6c8faa218848484e2ad4579bb83efc823e41"} Jul 13 21:21:12.677882 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:12.677817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fcbf7c7b4-2w6qx" event={"ID":"5c65adaf-c022-4517-8929-09084eb40f43","Type":"ContainerStarted","Data":"04b8c623e6cf82539ac3c010b6ff7ec3a481ff054aa532519d0d3e2812ade2ef"} Jul 13 21:21:12.709750 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:12.709691 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7fcbf7c7b4-2w6qx" podStartSLOduration=2.1468721889999998 podStartE2EDuration="2.709671717s" totalImagesPullingTime="562.799528ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:21:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:21:12.707759281 +0000 UTC m=+712.040423722" watchObservedRunningTime="2026-07-13 21:21:12.709671717 +0000 UTC m=+712.042336157" Jul 13 21:21:12.760609 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:12.760526 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54944c7dc7-xlct9"] Jul 13 21:21:12.760779 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:12.760715 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-54944c7dc7-xlct9" podUID="4d7369ab-74fe-4d12-b104-b2b90504dec1" containerName="authorino" containerID="cri-o://ad823f31b4a6c44d60fefbbbe7da80a31ae2633b7c51d0cc61b11a50f21615ca" gracePeriod=30 Jul 13 21:21:13.008917 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.008893 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54944c7dc7-xlct9" Jul 13 21:21:13.122507 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.122476 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d7369ab-74fe-4d12-b104-b2b90504dec1-tls-cert\") pod \"4d7369ab-74fe-4d12-b104-b2b90504dec1\" (UID: \"4d7369ab-74fe-4d12-b104-b2b90504dec1\") " Jul 13 21:21:13.122662 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.122552 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f68wp\" (UniqueName: \"kubernetes.io/projected/4d7369ab-74fe-4d12-b104-b2b90504dec1-kube-api-access-f68wp\") pod \"4d7369ab-74fe-4d12-b104-b2b90504dec1\" (UID: \"4d7369ab-74fe-4d12-b104-b2b90504dec1\") " Jul 13 21:21:13.124672 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.124631 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d7369ab-74fe-4d12-b104-b2b90504dec1-kube-api-access-f68wp" (OuterVolumeSpecName: "kube-api-access-f68wp") pod "4d7369ab-74fe-4d12-b104-b2b90504dec1" (UID: "4d7369ab-74fe-4d12-b104-b2b90504dec1"). InnerVolumeSpecName "kube-api-access-f68wp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:21:13.132328 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.132300 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d7369ab-74fe-4d12-b104-b2b90504dec1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4d7369ab-74fe-4d12-b104-b2b90504dec1" (UID: "4d7369ab-74fe-4d12-b104-b2b90504dec1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:21:13.223882 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.223826 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d7369ab-74fe-4d12-b104-b2b90504dec1-tls-cert\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:21:13.223882 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.223883 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f68wp\" (UniqueName: \"kubernetes.io/projected/4d7369ab-74fe-4d12-b104-b2b90504dec1-kube-api-access-f68wp\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:21:13.684239 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.684143 2576 generic.go:356] "Generic (PLEG): container finished" podID="4d7369ab-74fe-4d12-b104-b2b90504dec1" containerID="ad823f31b4a6c44d60fefbbbe7da80a31ae2633b7c51d0cc61b11a50f21615ca" exitCode=0 Jul 13 21:21:13.684239 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.684187 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54944c7dc7-xlct9" event={"ID":"4d7369ab-74fe-4d12-b104-b2b90504dec1","Type":"ContainerDied","Data":"ad823f31b4a6c44d60fefbbbe7da80a31ae2633b7c51d0cc61b11a50f21615ca"} Jul 13 21:21:13.684239 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.684203 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54944c7dc7-xlct9" Jul 13 21:21:13.684239 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.684237 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54944c7dc7-xlct9" event={"ID":"4d7369ab-74fe-4d12-b104-b2b90504dec1","Type":"ContainerDied","Data":"94dce13bfcfdeb41a6cd0ec99de28e7c3a0964f344cd31c743cbe8b0ae147f7a"} Jul 13 21:21:13.684872 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.684255 2576 scope.go:117] "RemoveContainer" containerID="ad823f31b4a6c44d60fefbbbe7da80a31ae2633b7c51d0cc61b11a50f21615ca" Jul 13 21:21:13.693032 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.693016 2576 scope.go:117] "RemoveContainer" containerID="ad823f31b4a6c44d60fefbbbe7da80a31ae2633b7c51d0cc61b11a50f21615ca" Jul 13 21:21:13.693306 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:21:13.693287 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad823f31b4a6c44d60fefbbbe7da80a31ae2633b7c51d0cc61b11a50f21615ca\": container with ID starting with ad823f31b4a6c44d60fefbbbe7da80a31ae2633b7c51d0cc61b11a50f21615ca not found: ID does not exist" containerID="ad823f31b4a6c44d60fefbbbe7da80a31ae2633b7c51d0cc61b11a50f21615ca" Jul 13 21:21:13.693363 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.693317 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad823f31b4a6c44d60fefbbbe7da80a31ae2633b7c51d0cc61b11a50f21615ca"} err="failed to get container status \"ad823f31b4a6c44d60fefbbbe7da80a31ae2633b7c51d0cc61b11a50f21615ca\": rpc error: code = NotFound desc = could not find container \"ad823f31b4a6c44d60fefbbbe7da80a31ae2633b7c51d0cc61b11a50f21615ca\": container with ID starting with ad823f31b4a6c44d60fefbbbe7da80a31ae2633b7c51d0cc61b11a50f21615ca not found: ID does not exist" Jul 13 21:21:13.699784 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.699759 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54944c7dc7-xlct9"] Jul 13 21:21:13.707987 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:13.707966 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54944c7dc7-xlct9"] Jul 13 21:21:15.279796 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:21:15.279765 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d7369ab-74fe-4d12-b104-b2b90504dec1" path="/var/lib/kubelet/pods/4d7369ab-74fe-4d12-b104-b2b90504dec1/volumes" Jul 13 21:47:33.361706 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:33.361662 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht"] Jul 13 21:47:33.362344 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:33.362230 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d7369ab-74fe-4d12-b104-b2b90504dec1" containerName="authorino" Jul 13 21:47:33.362344 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:33.362251 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d7369ab-74fe-4d12-b104-b2b90504dec1" containerName="authorino" Jul 13 21:47:33.362459 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:33.362358 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d7369ab-74fe-4d12-b104-b2b90504dec1" containerName="authorino" Jul 13 21:47:33.365315 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:33.365293 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht" Jul 13 21:47:33.367691 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:33.367670 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xxvfz\"" Jul 13 21:47:33.373096 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:33.373078 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht"] Jul 13 21:47:33.407813 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:33.407778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21e76f6e-618d-4770-9819-51d6da50139c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht\" (UID: \"21e76f6e-618d-4770-9819-51d6da50139c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht" Jul 13 21:47:33.508555 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:33.508518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21e76f6e-618d-4770-9819-51d6da50139c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht\" (UID: \"21e76f6e-618d-4770-9819-51d6da50139c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht" Jul 13 21:47:33.509191 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:33.509171 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21e76f6e-618d-4770-9819-51d6da50139c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht\" (UID: \"21e76f6e-618d-4770-9819-51d6da50139c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht" Jul 13 21:47:33.677125 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:33.677032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht" Jul 13 21:47:33.810645 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:33.810614 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht"] Jul 13 21:47:33.814456 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:47:33.814432 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e76f6e_618d_4770_9819_51d6da50139c.slice/crio-9f1912e2904c1f0af9336f29fd005d9f1570eb5385858ad682ceb08f37aa18b3 WatchSource:0}: Error finding container 9f1912e2904c1f0af9336f29fd005d9f1570eb5385858ad682ceb08f37aa18b3: Status 404 returned error can't find the container with id 9f1912e2904c1f0af9336f29fd005d9f1570eb5385858ad682ceb08f37aa18b3 Jul 13 21:47:33.816626 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:33.816612 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 21:47:33.880817 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:33.880777 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht" event={"ID":"21e76f6e-618d-4770-9819-51d6da50139c","Type":"ContainerStarted","Data":"9f1912e2904c1f0af9336f29fd005d9f1570eb5385858ad682ceb08f37aa18b3"} Jul 13 21:47:36.901522 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:36.901485 2576 generic.go:356] "Generic (PLEG): container finished" podID="21e76f6e-618d-4770-9819-51d6da50139c" containerID="724969787d1d505229b580d80fdb34282e8b5de9dc2127890de29c4ccc839b4a" exitCode=0 Jul 13 21:47:36.901967 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:36.901563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht" event={"ID":"21e76f6e-618d-4770-9819-51d6da50139c","Type":"ContainerDied","Data":"724969787d1d505229b580d80fdb34282e8b5de9dc2127890de29c4ccc839b4a"} Jul 13 21:47:38.037539 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:38.037518 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht" Jul 13 21:47:38.151106 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:38.151074 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21e76f6e-618d-4770-9819-51d6da50139c-maas-api-service-ca\") pod \"21e76f6e-618d-4770-9819-51d6da50139c\" (UID: \"21e76f6e-618d-4770-9819-51d6da50139c\") " Jul 13 21:47:38.151461 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:38.151433 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21e76f6e-618d-4770-9819-51d6da50139c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "21e76f6e-618d-4770-9819-51d6da50139c" (UID: "21e76f6e-618d-4770-9819-51d6da50139c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:47:38.252461 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:38.252427 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21e76f6e-618d-4770-9819-51d6da50139c-maas-api-service-ca\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:47:38.911044 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:38.911020 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht" Jul 13 21:47:38.911044 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:38.911038 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht" event={"ID":"21e76f6e-618d-4770-9819-51d6da50139c","Type":"ContainerDied","Data":"9f1912e2904c1f0af9336f29fd005d9f1570eb5385858ad682ceb08f37aa18b3"} Jul 13 21:47:38.911256 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:38.911086 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f1912e2904c1f0af9336f29fd005d9f1570eb5385858ad682ceb08f37aa18b3" Jul 13 21:47:59.425394 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:59.425358 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8"] Jul 13 21:47:59.425793 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:59.425738 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e76f6e-618d-4770-9819-51d6da50139c" containerName="revoke-keys" Jul 13 21:47:59.425793 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:59.425750 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e76f6e-618d-4770-9819-51d6da50139c" containerName="revoke-keys" Jul 13 21:47:59.425908 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:59.425812 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="21e76f6e-618d-4770-9819-51d6da50139c" containerName="revoke-keys" Jul 13 21:47:59.428720 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:59.428704 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8" Jul 13 21:47:59.431160 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:59.431140 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xxvfz\"" Jul 13 21:47:59.437038 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:59.437014 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8"] Jul 13 21:47:59.547867 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:59.547825 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efccb435-ba97-429b-a780-236eb0554684-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8\" (UID: \"efccb435-ba97-429b-a780-236eb0554684\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8" Jul 13 21:47:59.648612 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:59.648568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efccb435-ba97-429b-a780-236eb0554684-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8\" (UID: \"efccb435-ba97-429b-a780-236eb0554684\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8" Jul 13 21:47:59.649302 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:59.649276 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efccb435-ba97-429b-a780-236eb0554684-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8\" (UID: \"efccb435-ba97-429b-a780-236eb0554684\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8" Jul 13 21:47:59.740140 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:59.740107 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8" Jul 13 21:47:59.871707 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:47:59.871673 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8"] Jul 13 21:47:59.875100 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:47:59.875067 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefccb435_ba97_429b_a780_236eb0554684.slice/crio-cd3473706e035e14017d9b083d8256807a13019aac6b656c2b7d3caea230b031 WatchSource:0}: Error finding container cd3473706e035e14017d9b083d8256807a13019aac6b656c2b7d3caea230b031: Status 404 returned error can't find the container with id cd3473706e035e14017d9b083d8256807a13019aac6b656c2b7d3caea230b031 Jul 13 21:48:00.013063 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:00.012975 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8" event={"ID":"efccb435-ba97-429b-a780-236eb0554684","Type":"ContainerStarted","Data":"cd3473706e035e14017d9b083d8256807a13019aac6b656c2b7d3caea230b031"} Jul 13 21:48:01.020140 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:01.020103 2576 generic.go:356] "Generic (PLEG): container finished" podID="efccb435-ba97-429b-a780-236eb0554684" containerID="b7fed4ec91719f25ccf0b88a7d1d510fec374ace52e881aa7d42532e54a5ba01" exitCode=0 Jul 13 21:48:01.020561 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:01.020198 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8" event={"ID":"efccb435-ba97-429b-a780-236eb0554684","Type":"ContainerDied","Data":"b7fed4ec91719f25ccf0b88a7d1d510fec374ace52e881aa7d42532e54a5ba01"} Jul 13 21:48:02.173421 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:02.173396 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8" Jul 13 21:48:02.273921 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:02.273884 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efccb435-ba97-429b-a780-236eb0554684-maas-api-service-ca\") pod \"efccb435-ba97-429b-a780-236eb0554684\" (UID: \"efccb435-ba97-429b-a780-236eb0554684\") " Jul 13 21:48:02.274244 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:02.274221 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efccb435-ba97-429b-a780-236eb0554684-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "efccb435-ba97-429b-a780-236eb0554684" (UID: "efccb435-ba97-429b-a780-236eb0554684"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:48:02.375308 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:02.375220 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efccb435-ba97-429b-a780-236eb0554684-maas-api-service-ca\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:48:03.033512 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:03.033477 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8" event={"ID":"efccb435-ba97-429b-a780-236eb0554684","Type":"ContainerDied","Data":"cd3473706e035e14017d9b083d8256807a13019aac6b656c2b7d3caea230b031"} Jul 13 21:48:03.033677 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:03.033525 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd3473706e035e14017d9b083d8256807a13019aac6b656c2b7d3caea230b031" Jul 13 21:48:03.033677 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:03.033489 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8" Jul 13 21:48:49.517304 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:49.517268 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-509096-frdnw"] Jul 13 21:48:49.517795 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:49.517631 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efccb435-ba97-429b-a780-236eb0554684" containerName="revoke-keys" Jul 13 21:48:49.517795 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:49.517642 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="efccb435-ba97-429b-a780-236eb0554684" containerName="revoke-keys" Jul 13 21:48:49.517795 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:49.517720 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="efccb435-ba97-429b-a780-236eb0554684" containerName="revoke-keys" Jul 13 21:48:49.520829 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:49.520811 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-509096-frdnw" Jul 13 21:48:49.523131 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:49.523112 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xxvfz\"" Jul 13 21:48:49.526756 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:49.526725 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-509096-frdnw"] Jul 13 21:48:49.602916 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:49.602881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-509096-frdnw\" (UID: \"281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-509096-frdnw" Jul 13 21:48:49.703737 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:49.703699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-509096-frdnw\" (UID: \"281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-509096-frdnw" Jul 13 21:48:49.704375 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:49.704353 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-509096-frdnw\" (UID: \"281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-509096-frdnw" Jul 13 21:48:49.834011 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:49.833919 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-509096-frdnw" Jul 13 21:48:49.965371 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:49.965339 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-509096-frdnw"] Jul 13 21:48:49.968621 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:48:49.968595 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod281f45e7_d7de_4d0a_bb2d_e64dc2e8bcbf.slice/crio-6c85a3cced9efa06823cbf490a6604707dc3cf0414e1ef1364e7b2f5cda4b942 WatchSource:0}: Error finding container 6c85a3cced9efa06823cbf490a6604707dc3cf0414e1ef1364e7b2f5cda4b942: Status 404 returned error can't find the container with id 6c85a3cced9efa06823cbf490a6604707dc3cf0414e1ef1364e7b2f5cda4b942 Jul 13 21:48:50.251298 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:50.251263 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-509096-frdnw" event={"ID":"281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf","Type":"ContainerStarted","Data":"e689c2c7309ffa9cb5dfbac37ca3c3156604611afac3bc707897515a14e9174a"} Jul 13 21:48:50.251461 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:50.251322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-509096-frdnw" event={"ID":"281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf","Type":"ContainerStarted","Data":"6c85a3cced9efa06823cbf490a6604707dc3cf0414e1ef1364e7b2f5cda4b942"} Jul 13 21:48:50.268030 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:50.267984 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-509096-frdnw" podStartSLOduration=1.267969259 podStartE2EDuration="1.267969259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:48:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:48:50.266233174 +0000 UTC m=+2369.598897619" watchObservedRunningTime="2026-07-13 21:48:50.267969259 +0000 UTC m=+2369.600633699" Jul 13 21:48:51.257141 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:51.257110 2576 generic.go:356] "Generic (PLEG): container finished" podID="281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf" containerID="e689c2c7309ffa9cb5dfbac37ca3c3156604611afac3bc707897515a14e9174a" exitCode=0 Jul 13 21:48:51.257550 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:51.257168 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-509096-frdnw" event={"ID":"281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf","Type":"ContainerDied","Data":"e689c2c7309ffa9cb5dfbac37ca3c3156604611afac3bc707897515a14e9174a"} Jul 13 21:48:52.387931 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:52.387903 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-509096-frdnw" Jul 13 21:48:52.528092 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:52.527996 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf-maas-api-service-ca\") pod \"281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf\" (UID: \"281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf\") " Jul 13 21:48:52.528359 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:52.528336 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf" (UID: "281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:48:52.629269 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:52.629225 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf-maas-api-service-ca\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:48:53.267343 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:53.267311 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-509096-frdnw" Jul 13 21:48:53.267540 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:53.267357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-509096-frdnw" event={"ID":"281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf","Type":"ContainerDied","Data":"6c85a3cced9efa06823cbf490a6604707dc3cf0414e1ef1364e7b2f5cda4b942"} Jul 13 21:48:53.267540 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:48:53.267431 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c85a3cced9efa06823cbf490a6604707dc3cf0414e1ef1364e7b2f5cda4b942" Jul 13 21:52:42.668738 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.668698 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2"] Jul 13 21:52:42.671169 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.669116 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf" containerName="revoke-keys" Jul 13 21:52:42.671169 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.669128 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf" containerName="revoke-keys" Jul 13 21:52:42.671169 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.669191 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf" containerName="revoke-keys" Jul 13 21:52:42.672089 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.672071 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.674598 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.674576 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8e2974\"/\"kube-root-ca.crt\"" Jul 13 21:52:42.674751 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.674735 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8e2974\"/\"default-dockercfg-9p8g5\"" Jul 13 21:52:42.674829 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.674815 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8e2974\"/\"openshift-service-ca.crt\"" Jul 13 21:52:42.674923 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.674828 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8e2974\"/\"sub-test-model-8e2974-kserve-self-signed-certs\"" Jul 13 21:52:42.687660 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.687635 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2"] Jul 13 21:52:42.749919 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.749885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-dshm\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.750090 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.749930 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/803414c9-aa4d-4f44-99e5-e6b5b5b00525-tls-certs\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.750090 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.750026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-tmp-dir\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.750180 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.750099 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nng5w\" (UniqueName: \"kubernetes.io/projected/803414c9-aa4d-4f44-99e5-e6b5b5b00525-kube-api-access-nng5w\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.750180 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.750151 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-home\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.750180 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.750172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-model-cache\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.850639 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.850569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nng5w\" (UniqueName: \"kubernetes.io/projected/803414c9-aa4d-4f44-99e5-e6b5b5b00525-kube-api-access-nng5w\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.850639 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.850613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-home\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.850639 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.850630 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-model-cache\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.850938 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.850684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-dshm\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.850938 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.850710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/803414c9-aa4d-4f44-99e5-e6b5b5b00525-tls-certs\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.850938 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.850738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-tmp-dir\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.851289 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.851266 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-home\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.851364 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.851320 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-model-cache\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.851692 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.851666 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-tmp-dir\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.857044 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.853763 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-dshm\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.857044 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.854297 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/803414c9-aa4d-4f44-99e5-e6b5b5b00525-tls-certs\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.861248 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.861225 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nng5w\" (UniqueName: \"kubernetes.io/projected/803414c9-aa4d-4f44-99e5-e6b5b5b00525-kube-api-access-nng5w\") pod \"sub-test-model-8e2974-kserve-746c5b4b45-w4sd2\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:42.981430 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:42.981393 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:43.115652 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:43.115625 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2"] Jul 13 21:52:43.118180 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:52:43.118150 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod803414c9_aa4d_4f44_99e5_e6b5b5b00525.slice/crio-32cc95702261d02d7c70d72f020b982c5f2defed7870d3570a3ab649515045ce WatchSource:0}: Error finding container 32cc95702261d02d7c70d72f020b982c5f2defed7870d3570a3ab649515045ce: Status 404 returned error can't find the container with id 32cc95702261d02d7c70d72f020b982c5f2defed7870d3570a3ab649515045ce Jul 13 21:52:43.318995 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:43.318911 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" event={"ID":"803414c9-aa4d-4f44-99e5-e6b5b5b00525","Type":"ContainerStarted","Data":"5a229bae036c7b4c02313bb3c1d043966e13a6bd94986f8afb9de41f56a7260d"} Jul 13 21:52:43.318995 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:43.318958 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" event={"ID":"803414c9-aa4d-4f44-99e5-e6b5b5b00525","Type":"ContainerStarted","Data":"32cc95702261d02d7c70d72f020b982c5f2defed7870d3570a3ab649515045ce"} Jul 13 21:52:43.336237 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:43.336185 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" podStartSLOduration=1.336165246 podStartE2EDuration="1.336165246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:52:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:52:43.335617798 +0000 UTC m=+2602.668282238" watchObservedRunningTime="2026-07-13 21:52:43.336165246 +0000 UTC m=+2602.668829688" Jul 13 21:52:52.981641 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:52.981597 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:52.982109 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:52.981792 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:52.994635 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:52.994612 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:52:53.380786 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:52:53.380700 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:53:42.899798 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:42.899766 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2"] Jul 13 21:53:57.919953 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:57.919903 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" podUID="803414c9-aa4d-4f44-99e5-e6b5b5b00525" containerName="main" containerID="cri-o://5a229bae036c7b4c02313bb3c1d043966e13a6bd94986f8afb9de41f56a7260d" gracePeriod=45 Jul 13 21:53:58.176731 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.176657 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:53:58.332994 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.332952 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-tmp-dir\") pod \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " Jul 13 21:53:58.333187 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.333043 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nng5w\" (UniqueName: \"kubernetes.io/projected/803414c9-aa4d-4f44-99e5-e6b5b5b00525-kube-api-access-nng5w\") pod \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " Jul 13 21:53:58.333187 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.333077 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-model-cache\") pod \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " Jul 13 21:53:58.333187 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.333112 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-home\") pod \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " Jul 13 21:53:58.333351 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.333276 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "803414c9-aa4d-4f44-99e5-e6b5b5b00525" (UID: "803414c9-aa4d-4f44-99e5-e6b5b5b00525"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:53:58.333411 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.333350 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-model-cache" (OuterVolumeSpecName: "model-cache") pod "803414c9-aa4d-4f44-99e5-e6b5b5b00525" (UID: "803414c9-aa4d-4f44-99e5-e6b5b5b00525"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:53:58.333411 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.333358 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-dshm\") pod \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " Jul 13 21:53:58.333411 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.333378 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-home" (OuterVolumeSpecName: "home") pod "803414c9-aa4d-4f44-99e5-e6b5b5b00525" (UID: "803414c9-aa4d-4f44-99e5-e6b5b5b00525"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:53:58.333587 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.333481 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/803414c9-aa4d-4f44-99e5-e6b5b5b00525-tls-certs\") pod \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\" (UID: \"803414c9-aa4d-4f44-99e5-e6b5b5b00525\") " Jul 13 21:53:58.334109 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.333931 2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-model-cache\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:53:58.334109 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.333954 2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-home\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:53:58.334109 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.333968 2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-tmp-dir\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:53:58.335670 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.335647 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-dshm" (OuterVolumeSpecName: "dshm") pod "803414c9-aa4d-4f44-99e5-e6b5b5b00525" (UID: "803414c9-aa4d-4f44-99e5-e6b5b5b00525"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:53:58.335795 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.335774 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/803414c9-aa4d-4f44-99e5-e6b5b5b00525-kube-api-access-nng5w" (OuterVolumeSpecName: "kube-api-access-nng5w") pod "803414c9-aa4d-4f44-99e5-e6b5b5b00525" (UID: "803414c9-aa4d-4f44-99e5-e6b5b5b00525"). InnerVolumeSpecName "kube-api-access-nng5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:53:58.335929 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.335907 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/803414c9-aa4d-4f44-99e5-e6b5b5b00525-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "803414c9-aa4d-4f44-99e5-e6b5b5b00525" (UID: "803414c9-aa4d-4f44-99e5-e6b5b5b00525"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:53:58.434879 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.434782 2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/803414c9-aa4d-4f44-99e5-e6b5b5b00525-tls-certs\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:53:58.434879 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.434828 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nng5w\" (UniqueName: \"kubernetes.io/projected/803414c9-aa4d-4f44-99e5-e6b5b5b00525-kube-api-access-nng5w\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:53:58.434879 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.434844 2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/803414c9-aa4d-4f44-99e5-e6b5b5b00525-dshm\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:53:58.680664 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.680627 2576 generic.go:356] "Generic (PLEG): container finished" podID="803414c9-aa4d-4f44-99e5-e6b5b5b00525" containerID="5a229bae036c7b4c02313bb3c1d043966e13a6bd94986f8afb9de41f56a7260d" exitCode=0 Jul 13 21:53:58.680838 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.680673 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" Jul 13 21:53:58.680838 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.680696 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" event={"ID":"803414c9-aa4d-4f44-99e5-e6b5b5b00525","Type":"ContainerDied","Data":"5a229bae036c7b4c02313bb3c1d043966e13a6bd94986f8afb9de41f56a7260d"} Jul 13 21:53:58.680838 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.680746 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2" event={"ID":"803414c9-aa4d-4f44-99e5-e6b5b5b00525","Type":"ContainerDied","Data":"32cc95702261d02d7c70d72f020b982c5f2defed7870d3570a3ab649515045ce"} Jul 13 21:53:58.680838 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.680768 2576 scope.go:117] "RemoveContainer" containerID="5a229bae036c7b4c02313bb3c1d043966e13a6bd94986f8afb9de41f56a7260d" Jul 13 21:53:58.691931 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.691906 2576 scope.go:117] "RemoveContainer" containerID="5a229bae036c7b4c02313bb3c1d043966e13a6bd94986f8afb9de41f56a7260d" Jul 13 21:53:58.692200 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:53:58.692180 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a229bae036c7b4c02313bb3c1d043966e13a6bd94986f8afb9de41f56a7260d\": container with ID starting with 5a229bae036c7b4c02313bb3c1d043966e13a6bd94986f8afb9de41f56a7260d not found: ID does not exist" containerID="5a229bae036c7b4c02313bb3c1d043966e13a6bd94986f8afb9de41f56a7260d" Jul 13 21:53:58.692293 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.692209 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a229bae036c7b4c02313bb3c1d043966e13a6bd94986f8afb9de41f56a7260d"} err="failed to get container status \"5a229bae036c7b4c02313bb3c1d043966e13a6bd94986f8afb9de41f56a7260d\": rpc error: code = NotFound desc = could not find container \"5a229bae036c7b4c02313bb3c1d043966e13a6bd94986f8afb9de41f56a7260d\": container with ID starting with 5a229bae036c7b4c02313bb3c1d043966e13a6bd94986f8afb9de41f56a7260d not found: ID does not exist" Jul 13 21:53:58.704476 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.704444 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2"] Jul 13 21:53:58.706881 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:58.706841 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8e2974/sub-test-model-8e2974-kserve-746c5b4b45-w4sd2"] Jul 13 21:53:59.280107 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:53:59.280072 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="803414c9-aa4d-4f44-99e5-e6b5b5b00525" path="/var/lib/kubelet/pods/803414c9-aa4d-4f44-99e5-e6b5b5b00525/volumes" Jul 13 21:55:25.252013 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:25.251973 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7630-140045777651504"] Jul 13 21:55:25.252489 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:25.252367 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="803414c9-aa4d-4f44-99e5-e6b5b5b00525" containerName="main" Jul 13 21:55:25.252489 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:25.252378 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="803414c9-aa4d-4f44-99e5-e6b5b5b00525" containerName="main" Jul 13 21:55:25.252489 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:25.252450 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="803414c9-aa4d-4f44-99e5-e6b5b5b00525" containerName="main" Jul 13 21:55:25.255649 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:25.255632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777651504" Jul 13 21:55:25.258467 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:25.258437 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bljmr\"" Jul 13 21:55:25.260975 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:25.260955 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140045777651504"] Jul 13 21:55:25.314590 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:25.314557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9vvw\" (UniqueName: \"kubernetes.io/projected/32d2ee29-b60d-43bc-adc2-6822b0841cb9-kube-api-access-r9vvw\") pod \"test-curl-7630-140045777651504\" (UID: \"32d2ee29-b60d-43bc-adc2-6822b0841cb9\") " pod="opendatahub/test-curl-7630-140045777651504" Jul 13 21:55:25.415397 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:25.415347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9vvw\" (UniqueName: \"kubernetes.io/projected/32d2ee29-b60d-43bc-adc2-6822b0841cb9-kube-api-access-r9vvw\") pod \"test-curl-7630-140045777651504\" (UID: \"32d2ee29-b60d-43bc-adc2-6822b0841cb9\") " pod="opendatahub/test-curl-7630-140045777651504" Jul 13 21:55:25.423067 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:25.423035 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9vvw\" (UniqueName: \"kubernetes.io/projected/32d2ee29-b60d-43bc-adc2-6822b0841cb9-kube-api-access-r9vvw\") pod \"test-curl-7630-140045777651504\" (UID: \"32d2ee29-b60d-43bc-adc2-6822b0841cb9\") " pod="opendatahub/test-curl-7630-140045777651504" Jul 13 21:55:25.565953 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:25.565851 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777651504" Jul 13 21:55:25.697848 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:25.697825 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140045777651504"] Jul 13 21:55:25.700413 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:55:25.700384 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32d2ee29_b60d_43bc_adc2_6822b0841cb9.slice/crio-6fd3c8efa3420a4384c542448115e92f938c39102fd75c6f5457d54f1f47f0a4 WatchSource:0}: Error finding container 6fd3c8efa3420a4384c542448115e92f938c39102fd75c6f5457d54f1f47f0a4: Status 404 returned error can't find the container with id 6fd3c8efa3420a4384c542448115e92f938c39102fd75c6f5457d54f1f47f0a4 Jul 13 21:55:25.701761 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:25.701744 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 21:55:26.100827 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:26.100783 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140045777651504" event={"ID":"32d2ee29-b60d-43bc-adc2-6822b0841cb9","Type":"ContainerStarted","Data":"6fd3c8efa3420a4384c542448115e92f938c39102fd75c6f5457d54f1f47f0a4"} Jul 13 21:55:27.106976 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:27.106938 2576 generic.go:356] "Generic (PLEG): container finished" podID="32d2ee29-b60d-43bc-adc2-6822b0841cb9" containerID="cfbd01f3d92cb353f767e55976ae84ddb5dee96c189424fe98a1df748e9cd9ce" exitCode=0 Jul 13 21:55:27.107369 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:27.107035 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140045777651504" event={"ID":"32d2ee29-b60d-43bc-adc2-6822b0841cb9","Type":"ContainerDied","Data":"cfbd01f3d92cb353f767e55976ae84ddb5dee96c189424fe98a1df748e9cd9ce"} Jul 13 21:55:28.253306 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.253281 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777651504" Jul 13 21:55:28.287757 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.287723 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7630-140045777651504_32d2ee29-b60d-43bc-adc2-6822b0841cb9/test-curl-7630-140045777651504/0.log" Jul 13 21:55:28.309875 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.309828 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7630-140045777651504"] Jul 13 21:55:28.311701 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.311680 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7630-140045777651504"] Jul 13 21:55:28.342784 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.342759 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9vvw\" (UniqueName: \"kubernetes.io/projected/32d2ee29-b60d-43bc-adc2-6822b0841cb9-kube-api-access-r9vvw\") pod \"32d2ee29-b60d-43bc-adc2-6822b0841cb9\" (UID: \"32d2ee29-b60d-43bc-adc2-6822b0841cb9\") " Jul 13 21:55:28.344938 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.344915 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32d2ee29-b60d-43bc-adc2-6822b0841cb9-kube-api-access-r9vvw" (OuterVolumeSpecName: "kube-api-access-r9vvw") pod "32d2ee29-b60d-43bc-adc2-6822b0841cb9" (UID: "32d2ee29-b60d-43bc-adc2-6822b0841cb9"). InnerVolumeSpecName "kube-api-access-r9vvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:55:28.424997 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.424915 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7630-140045777651120"] Jul 13 21:55:28.425281 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.425268 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32d2ee29-b60d-43bc-adc2-6822b0841cb9" containerName="test-curl-7630-140045777651504" Jul 13 21:55:28.425323 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.425283 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="32d2ee29-b60d-43bc-adc2-6822b0841cb9" containerName="test-curl-7630-140045777651504" Jul 13 21:55:28.425358 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.425333 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="32d2ee29-b60d-43bc-adc2-6822b0841cb9" containerName="test-curl-7630-140045777651504" Jul 13 21:55:28.428298 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.428281 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777651120" Jul 13 21:55:28.433568 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.433547 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140045777651120"] Jul 13 21:55:28.443644 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.443622 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9vvw\" (UniqueName: \"kubernetes.io/projected/32d2ee29-b60d-43bc-adc2-6822b0841cb9-kube-api-access-r9vvw\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:55:28.544732 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.544697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbt72\" (UniqueName: \"kubernetes.io/projected/32be1dfc-2509-4276-b8dd-a9bcba5cdd05-kube-api-access-pbt72\") pod \"test-curl-7630-140045777651120\" (UID: \"32be1dfc-2509-4276-b8dd-a9bcba5cdd05\") " pod="opendatahub/test-curl-7630-140045777651120" Jul 13 21:55:28.645686 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.645649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbt72\" (UniqueName: \"kubernetes.io/projected/32be1dfc-2509-4276-b8dd-a9bcba5cdd05-kube-api-access-pbt72\") pod \"test-curl-7630-140045777651120\" (UID: \"32be1dfc-2509-4276-b8dd-a9bcba5cdd05\") " pod="opendatahub/test-curl-7630-140045777651120" Jul 13 21:55:28.653416 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.653385 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbt72\" (UniqueName: \"kubernetes.io/projected/32be1dfc-2509-4276-b8dd-a9bcba5cdd05-kube-api-access-pbt72\") pod \"test-curl-7630-140045777651120\" (UID: \"32be1dfc-2509-4276-b8dd-a9bcba5cdd05\") " pod="opendatahub/test-curl-7630-140045777651120" Jul 13 21:55:28.737979 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.737946 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777651120" Jul 13 21:55:28.867490 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:28.867468 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140045777651120"] Jul 13 21:55:28.869301 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:55:28.869270 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32be1dfc_2509_4276_b8dd_a9bcba5cdd05.slice/crio-150fb1dae34f5ec8ab976ff7997b4bce243121f5b88192bc72f040951da4ac2d WatchSource:0}: Error finding container 150fb1dae34f5ec8ab976ff7997b4bce243121f5b88192bc72f040951da4ac2d: Status 404 returned error can't find the container with id 150fb1dae34f5ec8ab976ff7997b4bce243121f5b88192bc72f040951da4ac2d Jul 13 21:55:29.117822 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:29.117734 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777651504" Jul 13 21:55:29.117822 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:29.117784 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fd3c8efa3420a4384c542448115e92f938c39102fd75c6f5457d54f1f47f0a4" Jul 13 21:55:29.118956 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:29.118930 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140045777651120" event={"ID":"32be1dfc-2509-4276-b8dd-a9bcba5cdd05","Type":"ContainerStarted","Data":"150fb1dae34f5ec8ab976ff7997b4bce243121f5b88192bc72f040951da4ac2d"} Jul 13 21:55:29.127980 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:55:29.127955 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7630-140045777651504\" is forbidden: User \"system:node:ip-10-0-133-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-136.ec2.internal' and this object" podUID="32d2ee29-b60d-43bc-adc2-6822b0841cb9" pod="opendatahub/test-curl-7630-140045777651504" Jul 13 21:55:29.280986 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:29.280961 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32d2ee29-b60d-43bc-adc2-6822b0841cb9" path="/var/lib/kubelet/pods/32d2ee29-b60d-43bc-adc2-6822b0841cb9/volumes" Jul 13 21:55:30.125801 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:30.125764 2576 generic.go:356] "Generic (PLEG): container finished" podID="32be1dfc-2509-4276-b8dd-a9bcba5cdd05" containerID="3af2a166014196e5491c156c1c6348e4bcbdcec386d8d3868a0bf06d385e3948" exitCode=0 Jul 13 21:55:30.125994 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:30.125804 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140045777651120" event={"ID":"32be1dfc-2509-4276-b8dd-a9bcba5cdd05","Type":"ContainerDied","Data":"3af2a166014196e5491c156c1c6348e4bcbdcec386d8d3868a0bf06d385e3948"} Jul 13 21:55:31.264817 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.264793 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777651120" Jul 13 21:55:31.286772 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.286734 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7630-140045777651120_32be1dfc-2509-4276-b8dd-a9bcba5cdd05/test-curl-7630-140045777651120/0.log" Jul 13 21:55:31.309752 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.309718 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7630-140045777651120"] Jul 13 21:55:31.313273 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.313249 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7630-140045777651120"] Jul 13 21:55:31.369449 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.369353 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbt72\" (UniqueName: \"kubernetes.io/projected/32be1dfc-2509-4276-b8dd-a9bcba5cdd05-kube-api-access-pbt72\") pod \"32be1dfc-2509-4276-b8dd-a9bcba5cdd05\" (UID: \"32be1dfc-2509-4276-b8dd-a9bcba5cdd05\") " Jul 13 21:55:31.371330 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.371294 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32be1dfc-2509-4276-b8dd-a9bcba5cdd05-kube-api-access-pbt72" (OuterVolumeSpecName: "kube-api-access-pbt72") pod "32be1dfc-2509-4276-b8dd-a9bcba5cdd05" (UID: "32be1dfc-2509-4276-b8dd-a9bcba5cdd05"). InnerVolumeSpecName "kube-api-access-pbt72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:55:31.462238 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.462205 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7630-140045777719344"] Jul 13 21:55:31.462583 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.462571 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32be1dfc-2509-4276-b8dd-a9bcba5cdd05" containerName="test-curl-7630-140045777651120" Jul 13 21:55:31.462632 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.462584 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="32be1dfc-2509-4276-b8dd-a9bcba5cdd05" containerName="test-curl-7630-140045777651120" Jul 13 21:55:31.462665 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.462643 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="32be1dfc-2509-4276-b8dd-a9bcba5cdd05" containerName="test-curl-7630-140045777651120" Jul 13 21:55:31.465406 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.465389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:31.470224 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.470199 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbt72\" (UniqueName: \"kubernetes.io/projected/32be1dfc-2509-4276-b8dd-a9bcba5cdd05-kube-api-access-pbt72\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:55:31.471532 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.471507 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140045777719344"] Jul 13 21:55:31.571472 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.571433 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c259\" (UniqueName: \"kubernetes.io/projected/0ed92f8a-1b10-4a68-8f44-d2271f21703f-kube-api-access-7c259\") pod \"test-curl-7630-140045777719344\" (UID: \"0ed92f8a-1b10-4a68-8f44-d2271f21703f\") " pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:31.672965 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.672922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c259\" (UniqueName: \"kubernetes.io/projected/0ed92f8a-1b10-4a68-8f44-d2271f21703f-kube-api-access-7c259\") pod \"test-curl-7630-140045777719344\" (UID: \"0ed92f8a-1b10-4a68-8f44-d2271f21703f\") " pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:31.681209 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.681177 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c259\" (UniqueName: \"kubernetes.io/projected/0ed92f8a-1b10-4a68-8f44-d2271f21703f-kube-api-access-7c259\") pod \"test-curl-7630-140045777719344\" (UID: \"0ed92f8a-1b10-4a68-8f44-d2271f21703f\") " pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:31.777180 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.777088 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:31.908188 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:31.908158 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140045777719344"] Jul 13 21:55:31.909552 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:55:31.909519 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ed92f8a_1b10_4a68_8f44_d2271f21703f.slice/crio-1d251e52b1d0c0306166180f9dcab880e6aa862a07a433f2f9f1991ad98b963e WatchSource:0}: Error finding container 1d251e52b1d0c0306166180f9dcab880e6aa862a07a433f2f9f1991ad98b963e: Status 404 returned error can't find the container with id 1d251e52b1d0c0306166180f9dcab880e6aa862a07a433f2f9f1991ad98b963e Jul 13 21:55:32.138232 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:32.138133 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777651120" Jul 13 21:55:32.138232 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:32.138139 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="150fb1dae34f5ec8ab976ff7997b4bce243121f5b88192bc72f040951da4ac2d" Jul 13 21:55:32.139393 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:32.139357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140045777719344" event={"ID":"0ed92f8a-1b10-4a68-8f44-d2271f21703f","Type":"ContainerStarted","Data":"1d251e52b1d0c0306166180f9dcab880e6aa862a07a433f2f9f1991ad98b963e"} Jul 13 21:55:32.149128 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:55:32.149097 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7630-140045777651120\" is forbidden: User \"system:node:ip-10-0-133-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-136.ec2.internal' and this object" podUID="32be1dfc-2509-4276-b8dd-a9bcba5cdd05" pod="opendatahub/test-curl-7630-140045777651120" Jul 13 21:55:33.145755 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:33.145721 2576 generic.go:356] "Generic (PLEG): container finished" podID="0ed92f8a-1b10-4a68-8f44-d2271f21703f" containerID="2336a23bdcd303ab7570364060dc7ec63727ebf054ee93460e856685efac3da4" exitCode=0 Jul 13 21:55:33.146154 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:33.145805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140045777719344" event={"ID":"0ed92f8a-1b10-4a68-8f44-d2271f21703f","Type":"ContainerDied","Data":"2336a23bdcd303ab7570364060dc7ec63727ebf054ee93460e856685efac3da4"} Jul 13 21:55:33.147699 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:55:33.147676 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7630-140045777651120\" is forbidden: User \"system:node:ip-10-0-133-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-136.ec2.internal' and this object" podUID="32be1dfc-2509-4276-b8dd-a9bcba5cdd05" pod="opendatahub/test-curl-7630-140045777651120" Jul 13 21:55:33.285700 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:33.280501 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32be1dfc-2509-4276-b8dd-a9bcba5cdd05" path="/var/lib/kubelet/pods/32be1dfc-2509-4276-b8dd-a9bcba5cdd05/volumes" Jul 13 21:55:34.280001 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.279971 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:34.298814 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.298741 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7630-140045777719344_0ed92f8a-1b10-4a68-8f44-d2271f21703f/test-curl-7630-140045777719344/0.log" Jul 13 21:55:34.320168 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.320134 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7630-140045777719344"] Jul 13 21:55:34.321949 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.321841 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7630-140045777719344"] Jul 13 21:55:34.397112 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.397077 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7c259\" (UniqueName: \"kubernetes.io/projected/0ed92f8a-1b10-4a68-8f44-d2271f21703f-kube-api-access-7c259\") pod \"0ed92f8a-1b10-4a68-8f44-d2271f21703f\" (UID: \"0ed92f8a-1b10-4a68-8f44-d2271f21703f\") " Jul 13 21:55:34.399127 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.399105 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ed92f8a-1b10-4a68-8f44-d2271f21703f-kube-api-access-7c259" (OuterVolumeSpecName: "kube-api-access-7c259") pod "0ed92f8a-1b10-4a68-8f44-d2271f21703f" (UID: "0ed92f8a-1b10-4a68-8f44-d2271f21703f"). InnerVolumeSpecName "kube-api-access-7c259". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:55:34.436016 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.435987 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7630-140045777719344"] Jul 13 21:55:34.436348 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.436335 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ed92f8a-1b10-4a68-8f44-d2271f21703f" containerName="test-curl-7630-140045777719344" Jul 13 21:55:34.436396 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.436349 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ed92f8a-1b10-4a68-8f44-d2271f21703f" containerName="test-curl-7630-140045777719344" Jul 13 21:55:34.436432 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.436417 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ed92f8a-1b10-4a68-8f44-d2271f21703f" containerName="test-curl-7630-140045777719344" Jul 13 21:55:34.439379 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.439364 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:34.444775 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.444753 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140045777719344"] Jul 13 21:55:34.498659 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.498628 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c259\" (UniqueName: \"kubernetes.io/projected/0ed92f8a-1b10-4a68-8f44-d2271f21703f-kube-api-access-7c259\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:55:34.599834 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.599798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz7g4\" (UniqueName: \"kubernetes.io/projected/3e510bf1-ab95-476b-9c8a-0e5d29a3a337-kube-api-access-dz7g4\") pod \"test-curl-7630-140045777719344\" (UID: \"3e510bf1-ab95-476b-9c8a-0e5d29a3a337\") " pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:34.700673 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.700601 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz7g4\" (UniqueName: \"kubernetes.io/projected/3e510bf1-ab95-476b-9c8a-0e5d29a3a337-kube-api-access-dz7g4\") pod \"test-curl-7630-140045777719344\" (UID: \"3e510bf1-ab95-476b-9c8a-0e5d29a3a337\") " pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:34.708735 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.708703 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz7g4\" (UniqueName: \"kubernetes.io/projected/3e510bf1-ab95-476b-9c8a-0e5d29a3a337-kube-api-access-dz7g4\") pod \"test-curl-7630-140045777719344\" (UID: \"3e510bf1-ab95-476b-9c8a-0e5d29a3a337\") " pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:34.749418 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.749393 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:34.880357 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:34.880332 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140045777719344"] Jul 13 21:55:34.882223 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:55:34.882200 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e510bf1_ab95_476b_9c8a_0e5d29a3a337.slice/crio-d58ce8a2595a83e7a42dc01c9d94385d1261929cd1055a1f129d71eadab886a7 WatchSource:0}: Error finding container d58ce8a2595a83e7a42dc01c9d94385d1261929cd1055a1f129d71eadab886a7: Status 404 returned error can't find the container with id d58ce8a2595a83e7a42dc01c9d94385d1261929cd1055a1f129d71eadab886a7 Jul 13 21:55:35.156082 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:35.156054 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:35.156272 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:35.156063 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d251e52b1d0c0306166180f9dcab880e6aa862a07a433f2f9f1991ad98b963e" Jul 13 21:55:35.157195 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:35.157163 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140045777719344" event={"ID":"3e510bf1-ab95-476b-9c8a-0e5d29a3a337","Type":"ContainerStarted","Data":"d58ce8a2595a83e7a42dc01c9d94385d1261929cd1055a1f129d71eadab886a7"} Jul 13 21:55:35.167604 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:35.167572 2576 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7630-140045777719344" oldPodUID="0ed92f8a-1b10-4a68-8f44-d2271f21703f" podUID="3e510bf1-ab95-476b-9c8a-0e5d29a3a337" Jul 13 21:55:35.280394 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:35.280357 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ed92f8a-1b10-4a68-8f44-d2271f21703f" path="/var/lib/kubelet/pods/0ed92f8a-1b10-4a68-8f44-d2271f21703f/volumes" Jul 13 21:55:36.164170 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:36.164131 2576 generic.go:356] "Generic (PLEG): container finished" podID="3e510bf1-ab95-476b-9c8a-0e5d29a3a337" containerID="8cd3287e13c57855b6d308de3572f37222e613b96f19680d8569ce3d1cb5135d" exitCode=0 Jul 13 21:55:36.164353 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:36.164187 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140045777719344" event={"ID":"3e510bf1-ab95-476b-9c8a-0e5d29a3a337","Type":"ContainerDied","Data":"8cd3287e13c57855b6d308de3572f37222e613b96f19680d8569ce3d1cb5135d"} Jul 13 21:55:37.308606 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.308580 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:37.326360 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.326334 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7630-140045777719344_3e510bf1-ab95-476b-9c8a-0e5d29a3a337/test-curl-7630-140045777719344/0.log" Jul 13 21:55:37.347831 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.347779 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7630-140045777719344"] Jul 13 21:55:37.349720 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.349698 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7630-140045777719344"] Jul 13 21:55:37.426053 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.425967 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz7g4\" (UniqueName: \"kubernetes.io/projected/3e510bf1-ab95-476b-9c8a-0e5d29a3a337-kube-api-access-dz7g4\") pod \"3e510bf1-ab95-476b-9c8a-0e5d29a3a337\" (UID: \"3e510bf1-ab95-476b-9c8a-0e5d29a3a337\") " Jul 13 21:55:37.428049 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.428013 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e510bf1-ab95-476b-9c8a-0e5d29a3a337-kube-api-access-dz7g4" (OuterVolumeSpecName: "kube-api-access-dz7g4") pod "3e510bf1-ab95-476b-9c8a-0e5d29a3a337" (UID: "3e510bf1-ab95-476b-9c8a-0e5d29a3a337"). InnerVolumeSpecName "kube-api-access-dz7g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:55:37.470477 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.470442 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7630-140045777720352"] Jul 13 21:55:37.470816 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.470804 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e510bf1-ab95-476b-9c8a-0e5d29a3a337" containerName="test-curl-7630-140045777719344" Jul 13 21:55:37.470877 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.470818 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e510bf1-ab95-476b-9c8a-0e5d29a3a337" containerName="test-curl-7630-140045777719344" Jul 13 21:55:37.470919 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.470904 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e510bf1-ab95-476b-9c8a-0e5d29a3a337" containerName="test-curl-7630-140045777719344" Jul 13 21:55:37.473833 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.473817 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777720352" Jul 13 21:55:37.479914 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.479890 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140045777720352"] Jul 13 21:55:37.526643 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.526615 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz7g4\" (UniqueName: \"kubernetes.io/projected/3e510bf1-ab95-476b-9c8a-0e5d29a3a337-kube-api-access-dz7g4\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:55:37.627891 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.627815 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9r48\" (UniqueName: \"kubernetes.io/projected/5ac5bf73-d7cb-428d-a69e-808c1f456aa7-kube-api-access-v9r48\") pod \"test-curl-7630-140045777720352\" (UID: \"5ac5bf73-d7cb-428d-a69e-808c1f456aa7\") " pod="opendatahub/test-curl-7630-140045777720352" Jul 13 21:55:37.728797 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.728765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9r48\" (UniqueName: \"kubernetes.io/projected/5ac5bf73-d7cb-428d-a69e-808c1f456aa7-kube-api-access-v9r48\") pod \"test-curl-7630-140045777720352\" (UID: \"5ac5bf73-d7cb-428d-a69e-808c1f456aa7\") " pod="opendatahub/test-curl-7630-140045777720352" Jul 13 21:55:37.736266 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.736235 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9r48\" (UniqueName: \"kubernetes.io/projected/5ac5bf73-d7cb-428d-a69e-808c1f456aa7-kube-api-access-v9r48\") pod \"test-curl-7630-140045777720352\" (UID: \"5ac5bf73-d7cb-428d-a69e-808c1f456aa7\") " pod="opendatahub/test-curl-7630-140045777720352" Jul 13 21:55:37.784195 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.784164 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777720352" Jul 13 21:55:37.915210 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:37.915157 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7630-140045777720352"] Jul 13 21:55:37.917922 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:55:37.917847 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ac5bf73_d7cb_428d_a69e_808c1f456aa7.slice/crio-7c3709ff446d1947f18018b744f9f0d4e2752b4da218b73694d3701c3dfb3d32 WatchSource:0}: Error finding container 7c3709ff446d1947f18018b744f9f0d4e2752b4da218b73694d3701c3dfb3d32: Status 404 returned error can't find the container with id 7c3709ff446d1947f18018b744f9f0d4e2752b4da218b73694d3701c3dfb3d32 Jul 13 21:55:38.175092 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:38.175006 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:38.175092 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:38.175013 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d58ce8a2595a83e7a42dc01c9d94385d1261929cd1055a1f129d71eadab886a7" Jul 13 21:55:38.176130 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:38.176105 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140045777720352" event={"ID":"5ac5bf73-d7cb-428d-a69e-808c1f456aa7","Type":"ContainerStarted","Data":"7c3709ff446d1947f18018b744f9f0d4e2752b4da218b73694d3701c3dfb3d32"} Jul 13 21:55:38.185403 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:55:38.185378 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7630-140045777719344\" is forbidden: User \"system:node:ip-10-0-133-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-136.ec2.internal' and this object" podUID="3e510bf1-ab95-476b-9c8a-0e5d29a3a337" pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:39.182009 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:39.181972 2576 generic.go:356] "Generic (PLEG): container finished" podID="5ac5bf73-d7cb-428d-a69e-808c1f456aa7" containerID="4f87ad16656d7ef1efb9ae1b0469e670b8d14e6712eb075650273ee17e936c24" exitCode=0 Jul 13 21:55:39.182388 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:39.182059 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7630-140045777720352" event={"ID":"5ac5bf73-d7cb-428d-a69e-808c1f456aa7","Type":"ContainerDied","Data":"4f87ad16656d7ef1efb9ae1b0469e670b8d14e6712eb075650273ee17e936c24"} Jul 13 21:55:39.184285 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:55:39.184260 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7630-140045777719344\" is forbidden: User \"system:node:ip-10-0-133-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-136.ec2.internal' and this object" podUID="3e510bf1-ab95-476b-9c8a-0e5d29a3a337" pod="opendatahub/test-curl-7630-140045777719344" Jul 13 21:55:39.279874 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:39.279830 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e510bf1-ab95-476b-9c8a-0e5d29a3a337" path="/var/lib/kubelet/pods/3e510bf1-ab95-476b-9c8a-0e5d29a3a337/volumes" Jul 13 21:55:40.336246 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:40.336223 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777720352" Jul 13 21:55:40.355770 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:40.355743 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7630-140045777720352_5ac5bf73-d7cb-428d-a69e-808c1f456aa7/test-curl-7630-140045777720352/0.log" Jul 13 21:55:40.376573 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:40.376543 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7630-140045777720352"] Jul 13 21:55:40.380592 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:40.380569 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7630-140045777720352"] Jul 13 21:55:40.453125 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:40.453051 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9r48\" (UniqueName: \"kubernetes.io/projected/5ac5bf73-d7cb-428d-a69e-808c1f456aa7-kube-api-access-v9r48\") pod \"5ac5bf73-d7cb-428d-a69e-808c1f456aa7\" (UID: \"5ac5bf73-d7cb-428d-a69e-808c1f456aa7\") " Jul 13 21:55:40.455198 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:40.455171 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac5bf73-d7cb-428d-a69e-808c1f456aa7-kube-api-access-v9r48" (OuterVolumeSpecName: "kube-api-access-v9r48") pod "5ac5bf73-d7cb-428d-a69e-808c1f456aa7" (UID: "5ac5bf73-d7cb-428d-a69e-808c1f456aa7"). InnerVolumeSpecName "kube-api-access-v9r48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:55:40.554133 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:40.554095 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9r48\" (UniqueName: \"kubernetes.io/projected/5ac5bf73-d7cb-428d-a69e-808c1f456aa7-kube-api-access-v9r48\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:55:41.193310 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:41.193285 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c3709ff446d1947f18018b744f9f0d4e2752b4da218b73694d3701c3dfb3d32" Jul 13 21:55:41.193491 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:41.193314 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7630-140045777720352" Jul 13 21:55:41.202693 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:55:41.202664 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7630-140045777720352\" is forbidden: User \"system:node:ip-10-0-133-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-136.ec2.internal' and this object" podUID="5ac5bf73-d7cb-428d-a69e-808c1f456aa7" pod="opendatahub/test-curl-7630-140045777720352" Jul 13 21:55:41.278966 ip-10-0-133-136 kubenswrapper[2576]: E0713 21:55:41.278930 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7630-140045777720352\" is forbidden: User \"system:node:ip-10-0-133-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-136.ec2.internal' and this object" podUID="5ac5bf73-d7cb-428d-a69e-808c1f456aa7" pod="opendatahub/test-curl-7630-140045777720352" Jul 13 21:55:41.279899 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:41.279879 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ac5bf73-d7cb-428d-a69e-808c1f456aa7" path="/var/lib/kubelet/pods/5ac5bf73-d7cb-428d-a69e-808c1f456aa7/volumes" Jul 13 21:55:43.913920 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:43.913820 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24"] Jul 13 21:55:43.914296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:43.914193 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac5bf73-d7cb-428d-a69e-808c1f456aa7" containerName="test-curl-7630-140045777720352" Jul 13 21:55:43.914296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:43.914206 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac5bf73-d7cb-428d-a69e-808c1f456aa7" containerName="test-curl-7630-140045777720352" Jul 13 21:55:43.914296 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:43.914277 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac5bf73-d7cb-428d-a69e-808c1f456aa7" containerName="test-curl-7630-140045777720352" Jul 13 21:55:43.917479 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:43.917462 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24" Jul 13 21:55:43.920167 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:43.920146 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xxvfz\"" Jul 13 21:55:43.926564 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:43.926539 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24"] Jul 13 21:55:44.084287 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:44.084249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7ed075b-0198-4655-941b-ee18c7fb2c66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24\" (UID: \"a7ed075b-0198-4655-941b-ee18c7fb2c66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24" Jul 13 21:55:44.185804 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:44.185720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7ed075b-0198-4655-941b-ee18c7fb2c66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24\" (UID: \"a7ed075b-0198-4655-941b-ee18c7fb2c66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24" Jul 13 21:55:44.186403 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:44.186380 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7ed075b-0198-4655-941b-ee18c7fb2c66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24\" (UID: \"a7ed075b-0198-4655-941b-ee18c7fb2c66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24" Jul 13 21:55:44.229053 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:44.229023 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24" Jul 13 21:55:44.360772 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:44.360741 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24"] Jul 13 21:55:44.363924 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:55:44.363886 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ed075b_0198_4655_941b_ee18c7fb2c66.slice/crio-d382a064a56094836fa018e2bfdfc1ef187d9679309a51aac099ded6be908f83 WatchSource:0}: Error finding container d382a064a56094836fa018e2bfdfc1ef187d9679309a51aac099ded6be908f83: Status 404 returned error can't find the container with id d382a064a56094836fa018e2bfdfc1ef187d9679309a51aac099ded6be908f83 Jul 13 21:55:45.218029 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:45.217997 2576 generic.go:356] "Generic (PLEG): container finished" podID="a7ed075b-0198-4655-941b-ee18c7fb2c66" containerID="40e1ff75520ed6244ba3afae87015aa13e2b14a20ac9efaa0afee96a3c61c880" exitCode=0 Jul 13 21:55:45.218390 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:45.218102 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24" event={"ID":"a7ed075b-0198-4655-941b-ee18c7fb2c66","Type":"ContainerDied","Data":"40e1ff75520ed6244ba3afae87015aa13e2b14a20ac9efaa0afee96a3c61c880"} Jul 13 21:55:45.218390 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:45.218157 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24" event={"ID":"a7ed075b-0198-4655-941b-ee18c7fb2c66","Type":"ContainerStarted","Data":"d382a064a56094836fa018e2bfdfc1ef187d9679309a51aac099ded6be908f83"} Jul 13 21:55:46.357457 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:46.357430 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24" Jul 13 21:55:46.508774 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:46.508662 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7ed075b-0198-4655-941b-ee18c7fb2c66-maas-api-service-ca\") pod \"a7ed075b-0198-4655-941b-ee18c7fb2c66\" (UID: \"a7ed075b-0198-4655-941b-ee18c7fb2c66\") " Jul 13 21:55:46.509113 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:46.509087 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7ed075b-0198-4655-941b-ee18c7fb2c66-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a7ed075b-0198-4655-941b-ee18c7fb2c66" (UID: "a7ed075b-0198-4655-941b-ee18c7fb2c66"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:55:46.610008 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:46.609972 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7ed075b-0198-4655-941b-ee18c7fb2c66-maas-api-service-ca\") on node \"ip-10-0-133-136.ec2.internal\" DevicePath \"\"" Jul 13 21:55:47.230444 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:47.230417 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24" Jul 13 21:55:47.230596 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:47.230410 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24" event={"ID":"a7ed075b-0198-4655-941b-ee18c7fb2c66","Type":"ContainerDied","Data":"d382a064a56094836fa018e2bfdfc1ef187d9679309a51aac099ded6be908f83"} Jul 13 21:55:47.230596 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:55:47.230536 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d382a064a56094836fa018e2bfdfc1ef187d9679309a51aac099ded6be908f83" Jul 13 21:56:36.397920 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:36.397882 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fcbf7c7b4-2w6qx_5c65adaf-c022-4517-8929-09084eb40f43/authorino/0.log" Jul 13 21:56:41.535509 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:41.535481 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fb46456c-kpxtx_ed4f1e8a-8b47-462c-bd29-5c43682e586f/copy-manifests/0.log" Jul 13 21:56:41.542144 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:41.542119 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fb46456c-kpxtx_ed4f1e8a-8b47-462c-bd29-5c43682e586f/manager/0.log" Jul 13 21:56:42.701398 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:42.701364 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-509096-frdnw_281f45e7-d7de-4d0a-bb2d-e64dc2e8bcbf/revoke-keys/0.log" Jul 13 21:56:43.029218 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:43.029182 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-8c4d43-dwqht_21e76f6e-618d-4770-9819-51d6da50139c/revoke-keys/0.log" Jul 13 21:56:43.134622 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:43.134572 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-2522e6-cqnt8_efccb435-ba97-429b-a780-236eb0554684/revoke-keys/0.log" Jul 13 21:56:43.578917 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:43.578883 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-8e2974-wzb24_a7ed075b-0198-4655-941b-ee18c7fb2c66/revoke-keys/0.log" Jul 13 21:56:43.792004 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:43.791972 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-r4bfj_2efb5736-31f3-4b42-82c2-3da5cd4a958b/postgres/0.log" Jul 13 21:56:45.031939 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:45.031906 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fcbf7c7b4-2w6qx_5c65adaf-c022-4517-8929-09084eb40f43/authorino/0.log" Jul 13 21:56:45.347809 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:45.347728 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-72zgb_47f97d25-ccb5-482d-896a-8be156dac09b/kuadrant-console-plugin/0.log" Jul 13 21:56:46.470021 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:46.469995 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-575f48bc89-tv6pl_2a10fa60-a87f-47fb-b871-84e8a7d2b44a/kube-auth-proxy/0.log" Jul 13 21:56:46.809384 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:46.809304 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-h4f9d_a165f8fb-3684-4e0e-8877-c186ac1c825a/payload-processing/0.log" Jul 13 21:56:47.237140 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:47.237115 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lnrtj_f7fe0b9a-bf52-487c-8ee2-96bd08e07798/main/0.log" Jul 13 21:56:47.450931 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:47.450903 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-lwg2g_215e44a2-e3cb-45fe-9447-96d4cf353d44/main/0.log" Jul 13 21:56:47.656672 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:47.656595 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-49nd5_56249e9f-1948-4ad8-903a-7c54ec1e74b9/main/0.log" Jul 13 21:56:54.006040 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:54.006009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5t86b_1426ed32-f4b7-404b-bfaf-6b7df8984ec6/global-pull-secret-syncer/0.log" Jul 13 21:56:54.136792 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:54.136757 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dr48r_09063215-9ffa-4812-bdc0-7ac55baa2433/konnectivity-agent/0.log" Jul 13 21:56:54.221555 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:54.221525 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-136.ec2.internal_54563f63446557ad0a7d2b139842ad20/haproxy/0.log" Jul 13 21:56:59.712748 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:59.712713 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fcbf7c7b4-2w6qx_5c65adaf-c022-4517-8929-09084eb40f43/authorino/0.log" Jul 13 21:56:59.803607 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:56:59.803579 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-72zgb_47f97d25-ccb5-482d-896a-8be156dac09b/kuadrant-console-plugin/0.log" Jul 13 21:57:02.567085 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:02.567055 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m8mmg_3453caf8-27a6-4020-8852-43075d64287d/node-exporter/0.log" Jul 13 21:57:02.602056 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:02.602029 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m8mmg_3453caf8-27a6-4020-8852-43075d64287d/kube-rbac-proxy/0.log" Jul 13 21:57:02.641674 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:02.641649 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m8mmg_3453caf8-27a6-4020-8852-43075d64287d/init-textfile/0.log" Jul 13 21:57:02.691979 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:02.691950 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7x8nb_ef8a4e7c-533a-43cf-b317-2947e7f40bbd/kube-rbac-proxy-main/0.log" Jul 13 21:57:02.727975 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:02.727943 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7x8nb_ef8a4e7c-533a-43cf-b317-2947e7f40bbd/kube-rbac-proxy-self/0.log" Jul 13 21:57:02.764306 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:02.764267 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7x8nb_ef8a4e7c-533a-43cf-b317-2947e7f40bbd/openshift-state-metrics/0.log" Jul 13 21:57:02.808110 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:02.808074 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3/prometheus/0.log" Jul 13 21:57:02.844069 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:02.843973 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3/config-reloader/0.log" Jul 13 21:57:02.879983 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:02.879953 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3/thanos-sidecar/0.log" Jul 13 21:57:02.918136 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:02.918103 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3/kube-rbac-proxy-web/0.log" Jul 13 21:57:02.949022 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:02.948990 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3/kube-rbac-proxy/0.log" Jul 13 21:57:02.985918 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:02.985889 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3/kube-rbac-proxy-thanos/0.log" Jul 13 21:57:03.019636 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:03.019605 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3fd3ebd5-03c3-44a5-b00d-2d7ab3a092d3/init-config-reloader/0.log" Jul 13 21:57:03.057771 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:03.057741 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-vgl89_a91f6c22-8fb6-4d89-ad47-84aaa6859846/prometheus-operator/0.log" Jul 13 21:57:03.083120 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:03.083092 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-vgl89_a91f6c22-8fb6-4d89-ad47-84aaa6859846/kube-rbac-proxy/0.log" Jul 13 21:57:03.111597 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:03.111490 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-wbtcf_767e1f02-03b3-4939-91f2-7f5f4309964d/prometheus-operator-admission-webhook/0.log" Jul 13 21:57:03.145637 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:03.145580 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d48f55d8f-9pmrd_a45d1ceb-98fa-4536-a681-3c0e88e5de30/telemeter-client/0.log" Jul 13 21:57:03.165394 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:03.165366 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d48f55d8f-9pmrd_a45d1ceb-98fa-4536-a681-3c0e88e5de30/reload/0.log" Jul 13 21:57:03.197601 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:03.197572 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d48f55d8f-9pmrd_a45d1ceb-98fa-4536-a681-3c0e88e5de30/kube-rbac-proxy/0.log" Jul 13 21:57:04.172630 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.172594 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch"] Jul 13 21:57:04.173015 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.172979 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7ed075b-0198-4655-941b-ee18c7fb2c66" containerName="revoke-keys" Jul 13 21:57:04.173015 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.172991 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7ed075b-0198-4655-941b-ee18c7fb2c66" containerName="revoke-keys" Jul 13 21:57:04.173092 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.173048 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7ed075b-0198-4655-941b-ee18c7fb2c66" containerName="revoke-keys" Jul 13 21:57:04.176059 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.176043 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.178249 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.178224 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s2kv7\"/\"openshift-service-ca.crt\"" Jul 13 21:57:04.178390 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.178374 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s2kv7\"/\"default-dockercfg-v2jnb\"" Jul 13 21:57:04.179344 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.179329 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s2kv7\"/\"kube-root-ca.crt\"" Jul 13 21:57:04.188352 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.188330 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch"] Jul 13 21:57:04.291468 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.291438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74a918d5-093a-4450-b544-01eb71cd016d-podres\") pod \"perf-node-gather-daemonset-nw4ch\" (UID: \"74a918d5-093a-4450-b544-01eb71cd016d\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.291629 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.291507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74a918d5-093a-4450-b544-01eb71cd016d-proc\") pod \"perf-node-gather-daemonset-nw4ch\" (UID: \"74a918d5-093a-4450-b544-01eb71cd016d\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.291629 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.291532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74a918d5-093a-4450-b544-01eb71cd016d-lib-modules\") pod \"perf-node-gather-daemonset-nw4ch\" (UID: \"74a918d5-093a-4450-b544-01eb71cd016d\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.291629 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.291562 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mrds\" (UniqueName: \"kubernetes.io/projected/74a918d5-093a-4450-b544-01eb71cd016d-kube-api-access-9mrds\") pod \"perf-node-gather-daemonset-nw4ch\" (UID: \"74a918d5-093a-4450-b544-01eb71cd016d\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.291629 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.291609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74a918d5-093a-4450-b544-01eb71cd016d-sys\") pod \"perf-node-gather-daemonset-nw4ch\" (UID: \"74a918d5-093a-4450-b544-01eb71cd016d\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.393020 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.392968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74a918d5-093a-4450-b544-01eb71cd016d-podres\") pod \"perf-node-gather-daemonset-nw4ch\" (UID: \"74a918d5-093a-4450-b544-01eb71cd016d\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.393222 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.393066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74a918d5-093a-4450-b544-01eb71cd016d-proc\") pod \"perf-node-gather-daemonset-nw4ch\" (UID: \"74a918d5-093a-4450-b544-01eb71cd016d\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.393222 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.393090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74a918d5-093a-4450-b544-01eb71cd016d-lib-modules\") pod \"perf-node-gather-daemonset-nw4ch\" (UID: \"74a918d5-093a-4450-b544-01eb71cd016d\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.393222 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.393129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mrds\" (UniqueName: \"kubernetes.io/projected/74a918d5-093a-4450-b544-01eb71cd016d-kube-api-access-9mrds\") pod \"perf-node-gather-daemonset-nw4ch\" (UID: \"74a918d5-093a-4450-b544-01eb71cd016d\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.393222 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.393158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74a918d5-093a-4450-b544-01eb71cd016d-sys\") pod \"perf-node-gather-daemonset-nw4ch\" (UID: \"74a918d5-093a-4450-b544-01eb71cd016d\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.393222 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.393166 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74a918d5-093a-4450-b544-01eb71cd016d-podres\") pod \"perf-node-gather-daemonset-nw4ch\" (UID: \"74a918d5-093a-4450-b544-01eb71cd016d\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.393222 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.393189 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74a918d5-093a-4450-b544-01eb71cd016d-proc\") pod \"perf-node-gather-daemonset-nw4ch\" (UID: \"74a918d5-093a-4450-b544-01eb71cd016d\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.393444 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.393241 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74a918d5-093a-4450-b544-01eb71cd016d-lib-modules\") pod \"perf-node-gather-daemonset-nw4ch\" (UID: \"74a918d5-093a-4450-b544-01eb71cd016d\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.393444 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.393248 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74a918d5-093a-4450-b544-01eb71cd016d-sys\") pod \"perf-node-gather-daemonset-nw4ch\" (UID: \"74a918d5-093a-4450-b544-01eb71cd016d\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.400601 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.400576 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mrds\" (UniqueName: \"kubernetes.io/projected/74a918d5-093a-4450-b544-01eb71cd016d-kube-api-access-9mrds\") pod \"perf-node-gather-daemonset-nw4ch\" (UID: \"74a918d5-093a-4450-b544-01eb71cd016d\") " pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.485348 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.485320 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:04.616344 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:04.616157 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch"] Jul 13 21:57:04.619120 ip-10-0-133-136 kubenswrapper[2576]: W0713 21:57:04.619087 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod74a918d5_093a_4450_b544_01eb71cd016d.slice/crio-faeb3c7fee58875e6e0913c570d96e0f866e091c246a9e1fa6711510a11fae53 WatchSource:0}: Error finding container faeb3c7fee58875e6e0913c570d96e0f866e091c246a9e1fa6711510a11fae53: Status 404 returned error can't find the container with id faeb3c7fee58875e6e0913c570d96e0f866e091c246a9e1fa6711510a11fae53 Jul 13 21:57:05.529528 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:05.529493 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-gqh8x_d4a72567-3385-4112-9960-850384d34c8b/download-server/0.log" Jul 13 21:57:05.626434 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:05.626398 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" event={"ID":"74a918d5-093a-4450-b544-01eb71cd016d","Type":"ContainerStarted","Data":"246553157fe9722bcfc17f4410edeb8ce4f927e602f22c328ffa5aad7545e78f"} Jul 13 21:57:05.626599 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:05.626465 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:05.626599 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:05.626487 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" event={"ID":"74a918d5-093a-4450-b544-01eb71cd016d","Type":"ContainerStarted","Data":"faeb3c7fee58875e6e0913c570d96e0f866e091c246a9e1fa6711510a11fae53"} Jul 13 21:57:05.642553 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:05.642495 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" podStartSLOduration=1.642481156 podStartE2EDuration="1.642481156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:57:05.641491987 +0000 UTC m=+2864.974156443" watchObservedRunningTime="2026-07-13 21:57:05.642481156 +0000 UTC m=+2864.975145612" Jul 13 21:57:06.081765 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:06.081738 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-lzrn6_4a0ae7b2-73f7-42c4-8617-fdb2050fc09e/volume-data-source-validator/0.log" Jul 13 21:57:07.084451 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:07.084413 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bb4gv_6fe1194f-2ccd-4288-ad07-602df2121359/dns/0.log" Jul 13 21:57:07.105032 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:07.105003 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bb4gv_6fe1194f-2ccd-4288-ad07-602df2121359/kube-rbac-proxy/0.log" Jul 13 21:57:07.243117 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:07.243089 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ndm6s_69296318-76d8-464f-88cb-eca82b0cb0f7/dns-node-resolver/0.log" Jul 13 21:57:07.805271 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:07.805240 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-854b6c8876-kvs84_541dafa8-bed7-492e-89e3-483fa362f228/registry/0.log" Jul 13 21:57:07.872138 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:07.872107 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vv2g9_989d6b5b-c88c-49a5-b4bb-16512682dddd/node-ca/0.log" Jul 13 21:57:09.008198 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:09.008167 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-575f48bc89-tv6pl_2a10fa60-a87f-47fb-b871-84e8a7d2b44a/kube-auth-proxy/0.log" Jul 13 21:57:09.159074 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:09.159042 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-h4f9d_a165f8fb-3684-4e0e-8877-c186ac1c825a/payload-processing/0.log" Jul 13 21:57:09.843271 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:09.843244 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fxsfr_faec6492-b638-486e-aa9f-fe5c3d5807df/serve-healthcheck-canary/0.log" Jul 13 21:57:10.450283 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:10.450250 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-njg2v_6ad6c5ea-3153-4c62-99de-0391c67b608d/kube-rbac-proxy/0.log" Jul 13 21:57:10.470121 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:10.470093 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-njg2v_6ad6c5ea-3153-4c62-99de-0391c67b608d/exporter/0.log" Jul 13 21:57:10.490219 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:10.490193 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-njg2v_6ad6c5ea-3153-4c62-99de-0391c67b608d/extractor/0.log" Jul 13 21:57:11.641310 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:11.641276 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s2kv7/perf-node-gather-daemonset-nw4ch" Jul 13 21:57:13.245464 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:13.245423 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fb46456c-kpxtx_ed4f1e8a-8b47-462c-bd29-5c43682e586f/manager/0.log" Jul 13 21:57:13.269011 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:13.268988 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fb46456c-kpxtx_ed4f1e8a-8b47-462c-bd29-5c43682e586f/copy-manifests/0.log" Jul 13 21:57:14.828678 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:14.828651 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-588f9fd4c6-bxjzr_a1d21e21-610e-448d-aacf-06a502556317/manager/0.log" Jul 13 21:57:15.334029 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:15.334003 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-575f48bc89-tv6pl_2a10fa60-a87f-47fb-b871-84e8a7d2b44a/kube-auth-proxy/0.log" Jul 13 21:57:15.454397 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:15.454364 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-h4f9d_a165f8fb-3684-4e0e-8877-c186ac1c825a/payload-processing/0.log" Jul 13 21:57:16.923563 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:16.923525 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-575f48bc89-tv6pl_2a10fa60-a87f-47fb-b871-84e8a7d2b44a/kube-auth-proxy/0.log" Jul 13 21:57:17.049152 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:17.049122 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-h4f9d_a165f8fb-3684-4e0e-8877-c186ac1c825a/payload-processing/0.log" Jul 13 21:57:19.730683 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:19.730651 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-bgmwt_aab9f9e5-64cd-4890-87b5-f732507bb2af/migrator/0.log" Jul 13 21:57:19.750038 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:19.750010 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-bgmwt_aab9f9e5-64cd-4890-87b5-f732507bb2af/graceful-termination/0.log" Jul 13 21:57:21.073209 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:21.073184 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2ch8_a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c/kube-multus-additional-cni-plugins/0.log" Jul 13 21:57:21.098215 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:21.098189 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2ch8_a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c/egress-router-binary-copy/0.log" Jul 13 21:57:21.118034 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:21.118003 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2ch8_a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c/cni-plugins/0.log" Jul 13 21:57:21.138205 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:21.138180 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2ch8_a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c/bond-cni-plugin/0.log" Jul 13 21:57:21.158143 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:21.158118 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2ch8_a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c/routeoverride-cni/0.log" Jul 13 21:57:21.177585 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:21.177531 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2ch8_a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c/whereabouts-cni-bincopy/0.log" Jul 13 21:57:21.197524 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:21.197492 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2ch8_a4ec0e5a-ca03-4aba-bc16-9a1f49a1180c/whereabouts-cni/0.log" Jul 13 21:57:21.575450 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:21.575411 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xkzpd_3d7a14a2-4edb-4728-8fe2-3a1838076a2d/kube-multus/0.log" Jul 13 21:57:21.703171 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:21.703142 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lrpd6_08ad96d7-5c9a-4f9a-a5ad-64d3949f5180/network-metrics-daemon/0.log" Jul 13 21:57:21.720729 ip-10-0-133-136 kubenswrapper[2576]: I0713 21:57:21.720701 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lrpd6_08ad96d7-5c9a-4f9a-a5ad-64d3949f5180/kube-rbac-proxy/0.log"