Jul 12 19:20:00.346558 ip-10-0-133-234 systemd[1]: Starting Kubernetes Kubelet... Jul 12 19:20:00.770328 ip-10-0-133-234 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 19:20:00.770328 ip-10-0-133-234 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 12 19:20:00.770328 ip-10-0-133-234 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 19:20:00.770328 ip-10-0-133-234 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 12 19:20:00.770328 ip-10-0-133-234 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 19:20:00.771336 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.771241 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 12 19:20:00.778716 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778692 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 19:20:00.778716 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778711 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 19:20:00.778716 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778717 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 19:20:00.778716 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778722 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 19:20:00.778716 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778725 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778728 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778732 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778735 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778737 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778740 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778743 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778746 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778748 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778751 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778754 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778757 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778759 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778762 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778765 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778768 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778770 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778773 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778775 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 19:20:00.778926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778778 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778780 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778783 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778785 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778787 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778790 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778796 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778798 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778801 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778803 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778806 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778810 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778814 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778817 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778819 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778825 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778828 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778830 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778833 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 19:20:00.779403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778836 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778839 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778842 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778844 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778847 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778850 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778853 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778856 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778860 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778863 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778865 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778868 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778870 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778873 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778875 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778878 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778880 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778883 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778885 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778888 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 19:20:00.779865 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778890 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778893 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778895 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778897 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778900 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778902 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778905 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778907 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778910 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778913 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778916 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778918 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778920 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778923 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778927 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778930 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778932 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778935 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778937 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778940 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 19:20:00.780353 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778943 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778946 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778948 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778950 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778953 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778955 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778957 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778960 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778962 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778965 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778967 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778969 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778972 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778974 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778977 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778981 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.778985 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780520 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780530 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 19:20:00.780833 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780533 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780536 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780541 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780545 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780549 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780553 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780556 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780559 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780561 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780564 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780567 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780570 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780573 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780575 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780578 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780583 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780586 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780589 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780592 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 19:20:00.781293 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780594 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780597 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780599 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780602 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780605 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780607 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780610 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780613 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780615 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780618 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780620 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780623 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780625 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780627 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780630 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780632 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780635 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780637 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780640 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780642 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 19:20:00.781868 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780645 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780647 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780649 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780652 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780654 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780657 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780659 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780661 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780664 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780675 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780678 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780680 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780683 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780685 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780688 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780691 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780693 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780696 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780698 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780701 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 19:20:00.782379 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780703 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780706 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780708 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780711 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780713 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780716 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780718 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780721 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780723 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780726 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780728 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780731 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780734 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780736 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780739 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780741 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780744 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780746 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780748 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780751 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 19:20:00.782870 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780754 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780757 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780760 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780762 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780765 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780767 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780770 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780772 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780774 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780777 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780779 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780781 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780784 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780787 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780791 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780793 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780796 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.780799 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781186 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 19:20:00.783370 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781192 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781195 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781198 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781200 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781203 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781206 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781209 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781212 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781214 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781217 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781220 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781222 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781225 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781229 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781231 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781236 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781240 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781243 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781245 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 19:20:00.783828 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781248 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781251 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781253 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781256 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781258 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781261 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781263 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781266 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781270 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781273 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781275 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781278 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781296 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781299 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781302 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781304 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781307 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781311 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781315 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 19:20:00.784334 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781317 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781320 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781323 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781325 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781327 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781330 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781334 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781336 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781339 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781342 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781345 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781347 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781350 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781353 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781355 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781357 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781360 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781362 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781365 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781367 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 19:20:00.784791 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781370 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781372 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781375 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781377 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781380 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781382 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781385 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781387 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781390 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781392 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781395 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781397 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781400 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781402 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781404 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781407 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781409 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781411 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781415 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781417 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 19:20:00.785268 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781420 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781422 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781426 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781429 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781432 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781434 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781436 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781439 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781441 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781444 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781446 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781449 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781451 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781454 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781456 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781459 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781461 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781464 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781466 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.781469 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781535 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 12 19:20:00.785792 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781542 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781548 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781552 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781557 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781562 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781568 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781574 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781578 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781583 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781586 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781590 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781593 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781596 2572 flags.go:64] FLAG: --cgroup-root="" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781598 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781601 2572 flags.go:64] FLAG: --client-ca-file="" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781605 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781608 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781612 2572 flags.go:64] FLAG: --cluster-domain="" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781615 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781618 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781621 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781624 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781627 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 12 19:20:00.786312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781630 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781633 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781636 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781639 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781642 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781645 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781648 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781650 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781654 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781657 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781660 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781662 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781665 2572 flags.go:64] FLAG: --enable-server="true" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781668 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781672 2572 flags.go:64] FLAG: --event-burst="100" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781675 2572 flags.go:64] FLAG: --event-qps="50" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781678 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781681 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781684 2572 flags.go:64] FLAG: --eviction-hard="" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781690 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781693 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781695 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781698 2572 flags.go:64] FLAG: --eviction-soft="" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781701 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781704 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 12 19:20:00.786875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781707 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781710 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781713 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781715 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781718 2572 flags.go:64] FLAG: --feature-gates="" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781722 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781725 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781728 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781731 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781734 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781736 2572 flags.go:64] FLAG: --help="false" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781739 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-133-234.ec2.internal" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781742 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781745 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781748 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781751 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781754 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781757 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781760 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781763 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781765 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781768 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781771 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781774 2572 flags.go:64] FLAG: --kube-reserved="" Jul 12 19:20:00.787575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781776 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781781 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781785 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781788 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781791 2572 flags.go:64] FLAG: --lock-file="" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781794 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781796 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781799 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781804 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781808 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781811 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781813 2572 flags.go:64] FLAG: --logging-format="text" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781816 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781819 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781822 2572 flags.go:64] FLAG: --manifest-url="" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781825 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781828 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781831 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781835 2572 flags.go:64] FLAG: --max-pods="110" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781838 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781841 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781844 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781847 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781850 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781853 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 12 19:20:00.788205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781856 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781863 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781866 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781869 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781872 2572 flags.go:64] FLAG: --pod-cidr="" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781875 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781880 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781883 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781887 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781890 2572 flags.go:64] FLAG: --port="10250" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781894 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781897 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cfd0213f4ea96484" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781900 2572 flags.go:64] FLAG: --qos-reserved="" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781903 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781906 2572 flags.go:64] FLAG: --register-node="true" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781909 2572 flags.go:64] FLAG: --register-with-taints="" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781913 2572 flags.go:64] FLAG: --registry-burst="10" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781916 2572 flags.go:64] FLAG: --registry-qps="5" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781919 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781921 2572 flags.go:64] FLAG: --reserved-memory="" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781925 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781928 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781931 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781933 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781936 2572 flags.go:64] FLAG: --runonce="false" Jul 12 19:20:00.788896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781939 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781942 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781945 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781948 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781951 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781953 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781956 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781959 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781962 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781965 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781967 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781970 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781973 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781976 2572 flags.go:64] FLAG: --system-cgroups="" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781978 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781984 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781988 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781992 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781995 2572 flags.go:64] FLAG: --tls-min-version="" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.781998 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.782001 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.782004 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.782006 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.782009 2572 flags.go:64] FLAG: --v="2" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.782013 2572 flags.go:64] FLAG: --version="false" Jul 12 19:20:00.789521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.782017 2572 flags.go:64] FLAG: --vmodule="" Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.782021 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.782032 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782170 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782174 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782177 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782180 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782185 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782188 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782190 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782195 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782198 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782202 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782205 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782207 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782210 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782212 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782215 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782218 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782220 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 19:20:00.790135 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782223 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782225 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782229 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782231 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782235 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782239 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782243 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782246 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782249 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782251 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782254 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782256 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782259 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782262 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782265 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782267 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782270 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782272 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782275 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782277 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 19:20:00.790639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782280 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782295 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782298 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782300 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782303 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782306 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782308 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782311 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782314 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782316 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782319 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782322 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782324 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782327 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782331 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782334 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782338 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782340 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782343 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782345 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 19:20:00.791160 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782348 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782350 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782353 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782355 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782358 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782360 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782363 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782366 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782368 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782370 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782373 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782375 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782378 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782382 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782385 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782388 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782391 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782393 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782396 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 19:20:00.791673 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782399 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782401 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782403 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782406 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782408 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782411 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782414 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782417 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782420 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782423 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782426 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782428 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782431 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782433 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782436 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782438 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782441 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782443 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782446 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782449 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 19:20:00.792141 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782451 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 19:20:00.792639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782454 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 19:20:00.792639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.782456 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 19:20:00.792639 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.783108 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 19:20:00.792639 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.789712 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 12 19:20:00.792639 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.789729 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 12 19:20:00.792639 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.789749 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 12 19:20:00.792639 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.789758 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 12 19:20:00.792639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789814 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 19:20:00.792639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789818 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 19:20:00.792639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789822 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 19:20:00.792639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789825 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 19:20:00.792639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789828 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 19:20:00.792639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789831 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 19:20:00.792639 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789833 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789836 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789839 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789841 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789844 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789846 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789849 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789851 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789855 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789859 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789862 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789865 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789867 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789870 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789872 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789875 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789877 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789879 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789882 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789884 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 19:20:00.792992 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789887 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789890 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789892 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789896 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789899 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789901 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789904 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789906 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789908 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789911 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789914 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789916 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789919 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789921 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789924 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789926 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789928 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789931 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789933 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789937 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 19:20:00.793499 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789941 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789944 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789946 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789949 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789951 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789954 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789956 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789959 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789961 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789964 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789966 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789969 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789971 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789974 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789978 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789981 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789984 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789986 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789989 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 19:20:00.794000 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789993 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789996 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.789999 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790002 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790004 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790008 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790010 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790013 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790016 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790018 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790020 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790032 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790035 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790038 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790041 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790043 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790046 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790048 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790051 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790053 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 19:20:00.794594 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790056 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 19:20:00.795083 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790058 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 19:20:00.795083 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790061 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 19:20:00.795083 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790063 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 19:20:00.795083 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790065 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 19:20:00.795083 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790068 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 19:20:00.795083 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790071 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 19:20:00.795083 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790074 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 19:20:00.795083 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790077 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 19:20:00.795083 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790080 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 19:20:00.795083 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790083 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 19:20:00.795083 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790085 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 19:20:00.795083 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790088 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 19:20:00.795083 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790091 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 19:20:00.795083 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.790096 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 19:20:00.795083 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790208 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790212 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790216 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790219 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790222 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790224 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790227 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790229 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790232 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790234 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790236 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790239 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790241 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790244 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790246 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790249 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790252 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790256 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790258 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 19:20:00.795472 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790261 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790263 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790265 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790268 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790270 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790273 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790276 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790278 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790296 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790301 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790305 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790309 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790312 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790315 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790317 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790320 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790322 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790325 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790327 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790330 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 19:20:00.795926 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790332 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790335 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790337 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790339 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790342 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790344 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790347 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790349 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790352 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790354 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790357 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790359 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790361 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790364 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790366 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790369 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790371 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790374 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790376 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790379 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 19:20:00.796425 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790381 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790384 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790387 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790389 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790392 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790394 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790397 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790399 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790401 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790404 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790406 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790409 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790411 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790414 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790416 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790418 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790421 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790424 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790427 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790430 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 19:20:00.796924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790433 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790436 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790438 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790440 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790443 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790445 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790447 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790450 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790452 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790455 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790457 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790460 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790462 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790465 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790468 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790470 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790473 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790475 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790478 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 19:20:00.797496 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:00.790480 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 19:20:00.798297 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.790485 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 19:20:00.798297 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.790587 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 12 19:20:00.798297 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.792650 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 12 19:20:00.798297 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.794002 2572 server.go:1019] "Starting client certificate rotation" Jul 12 19:20:00.798297 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.794098 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 12 19:20:00.798297 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.794126 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 12 19:20:00.798297 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.796611 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 12 19:20:00.801881 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.801861 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 12 19:20:00.810066 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.810049 2572 log.go:25] "Validated CRI v1 runtime API" Jul 12 19:20:00.812934 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.812912 2572 log.go:25] "Validated CRI v1 image API" Jul 12 19:20:00.813803 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.813777 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 12 19:20:00.818633 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.818614 2572 fs.go:135] Filesystem UUIDs: map[4776bcfd-9afb-45d0-8915-4721531b7b37:/dev/nvme0n1p4 483bd15f-e0ac-4520-a7c5-03d915c2f1dc:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 12 19:20:00.818693 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.818632 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 12 19:20:00.823593 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.823460 2572 manager.go:216] Machine: {Timestamp:2026-07-12 19:20:00.822173452 +0000 UTC m=+0.356161617 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102245 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26c591c875ce1bd7a45d2cd1a7fff1 SystemUUID:ec26c591-c875-ce1b-d7a4-5d2cd1a7fff1 BootID:757da5d3-40c9-4157-a1a7-009f4fa1ff85 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:84:2d:f1:6a:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:84:2d:f1:6a:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:ca:6d:18:23:bb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 12 19:20:00.823593 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.823580 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 12 19:20:00.823723 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.823613 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 12 19:20:00.823723 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.823656 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 12 19:20:00.826789 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.826762 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 12 19:20:00.826931 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.826793 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 12 19:20:00.827562 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.827553 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 12 19:20:00.827595 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.827565 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 12 19:20:00.827595 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.827577 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 12 19:20:00.828396 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.828386 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 12 19:20:00.829274 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.829266 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 12 19:20:00.832360 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.832348 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 12 19:20:00.832483 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.832474 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 12 19:20:00.832520 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.832506 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 12 19:20:00.832520 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.832519 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 12 19:20:00.832571 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.832543 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 12 19:20:00.832571 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.832561 2572 kubelet.go:398] "Adding apiserver pod source" Jul 12 19:20:00.832623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.832573 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 12 19:20:00.832929 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.832919 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 12 19:20:00.832960 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.832936 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 12 19:20:00.835983 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.835968 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 12 19:20:00.837829 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.837811 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 12 19:20:00.837901 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.837881 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 12 19:20:00.838519 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.838508 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 12 19:20:00.838563 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.838524 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 12 19:20:00.838563 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.838530 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 12 19:20:00.838563 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.838537 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 12 19:20:00.838563 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.838545 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 12 19:20:00.838563 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.838551 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 12 19:20:00.838714 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.838706 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 12 19:20:00.838748 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.838715 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 12 19:20:00.838748 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.838721 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 12 19:20:00.838748 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.838727 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 12 19:20:00.838748 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.838740 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 12 19:20:00.838748 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.838748 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 12 19:20:00.839547 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.839535 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 12 19:20:00.839577 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.839549 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 12 19:20:00.842372 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.842348 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 12 19:20:00.842372 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:00.842363 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 12 19:20:00.842514 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:00.842366 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 12 19:20:00.843387 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.843373 2572 server.go:1268] "Started kubelet" Jul 12 19:20:00.843480 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.843461 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 12 19:20:00.843721 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.843611 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 12 19:20:00.843826 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.843794 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7fnzn" Jul 12 19:20:00.843826 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.843819 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 12 19:20:00.844374 ip-10-0-133-234 systemd[1]: Started Kubernetes Kubelet. Jul 12 19:20:00.848178 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.848154 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 12 19:20:00.849527 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:00.849494 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 12 19:20:00.850508 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.850492 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 12 19:20:00.851474 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.851458 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7fnzn" Jul 12 19:20:00.853097 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:00.852075 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-234.ec2.internal.18c1a10c1ec52f7c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-234.ec2.internal,UID:ip-10-0-133-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-234.ec2.internal,},FirstTimestamp:2026-07-12 19:20:00.843345788 +0000 UTC m=+0.377333956,LastTimestamp:2026-07-12 19:20:00.843345788 +0000 UTC m=+0.377333956,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-234.ec2.internal,}" Jul 12 19:20:00.855649 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.855622 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 12 19:20:00.855649 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.855640 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 12 19:20:00.855782 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:00.855760 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jul 12 19:20:00.856426 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.856409 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 12 19:20:00.856502 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.856447 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 12 19:20:00.856502 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.856409 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 12 19:20:00.856616 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.856571 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 12 19:20:00.856616 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.856578 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 12 19:20:00.856860 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.856842 2572 factory.go:55] Registering systemd factory Jul 12 19:20:00.856860 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.856863 2572 factory.go:223] Registration of the systemd container factory successfully Jul 12 19:20:00.857128 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.857108 2572 factory.go:153] Registering CRI-O factory Jul 12 19:20:00.857128 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.857128 2572 factory.go:223] Registration of the crio container factory successfully Jul 12 19:20:00.857235 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.857182 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 12 19:20:00.857235 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.857204 2572 factory.go:103] Registering Raw factory Jul 12 19:20:00.857235 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.857218 2572 manager.go:1196] Started watching for new ooms in manager Jul 12 19:20:00.857834 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.857811 2572 manager.go:349] Starting recovery of all containers Jul 12 19:20:00.866441 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.866257 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 19:20:00.866613 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.866581 2572 manager.go:354] Recovery completed Jul 12 19:20:00.869007 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:00.868986 2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-234.ec2.internal\" not found" node="ip-10-0-133-234.ec2.internal" Jul 12 19:20:00.870991 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.870975 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 19:20:00.875983 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.875968 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory" Jul 12 19:20:00.876057 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.876000 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 19:20:00.876057 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.876013 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID" Jul 12 19:20:00.876547 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.876533 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 12 19:20:00.876547 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.876545 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 12 19:20:00.876547 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.876548 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 19:20:00.876681 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.876560 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 12 19:20:00.877326 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.877311 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory" Jul 12 19:20:00.877390 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.877344 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 19:20:00.877390 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.877358 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID" Jul 12 19:20:00.877852 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.877840 2572 policy_none.go:49] "None policy: Start" Jul 12 19:20:00.877896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.877855 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 12 19:20:00.877896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.877865 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 12 19:20:00.878937 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.878927 2572 policy_none.go:47] "Start" Jul 12 19:20:00.908859 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.908843 2572 manager.go:337] "Starting Device Plugin manager" Jul 12 19:20:00.908961 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:00.908874 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 12 19:20:00.908961 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.908884 2572 server.go:87] "Starting device plugin registration server" Jul 12 19:20:00.909123 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.909110 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 12 19:20:00.909156 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.909127 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 12 19:20:00.909330 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.909317 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 12 19:20:00.909400 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.909389 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 12 19:20:00.909445 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:00.909401 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 12 19:20:00.909923 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:00.909902 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 12 19:20:00.910005 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:00.909958 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-234.ec2.internal\" not found" Jul 12 19:20:01.003735 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.003701 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 12 19:20:01.004978 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.004954 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 12 19:20:01.005040 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.005006 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 12 19:20:01.005040 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.005032 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 12 19:20:01.005105 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:01.005075 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 12 19:20:01.007063 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.007041 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 19:20:01.009420 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.009402 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 19:20:01.010155 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.010140 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory" Jul 12 19:20:01.010220 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.010165 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 19:20:01.010220 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.010176 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID" Jul 12 19:20:01.010220 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.010201 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.015919 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.015905 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.015965 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:01.015925 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-234.ec2.internal\": node \"ip-10-0-133-234.ec2.internal\" not found" Jul 12 19:20:01.028867 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:01.028826 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jul 12 19:20:01.106011 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.105974 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal"] Jul 12 19:20:01.106165 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.106064 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 19:20:01.107126 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.107108 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory" Jul 12 19:20:01.107214 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.107140 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 19:20:01.107214 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.107151 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID" Jul 12 19:20:01.108487 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.108475 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 19:20:01.108611 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.108596 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.108669 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.108624 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 19:20:01.109236 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.109209 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory" Jul 12 19:20:01.109236 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.109220 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory" Jul 12 19:20:01.109370 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.109240 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 19:20:01.109370 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.109244 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 19:20:01.109370 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.109254 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID" Jul 12 19:20:01.109370 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.109254 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID" Jul 12 19:20:01.110547 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.110526 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.110642 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.110569 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 19:20:01.111667 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.111651 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory" Jul 12 19:20:01.111759 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.111682 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 19:20:01.111759 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.111695 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID" Jul 12 19:20:01.129211 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:01.129182 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jul 12 19:20:01.139846 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:01.139821 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-234.ec2.internal\" not found" node="ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.144104 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:01.144086 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-234.ec2.internal\" not found" node="ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.157885 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.157870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6fba7a483df990721f423a08a6cb4680-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"6fba7a483df990721f423a08a6cb4680\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.157963 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.157901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fba7a483df990721f423a08a6cb4680-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"6fba7a483df990721f423a08a6cb4680\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.157963 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.157918 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2df761e96899302463c4ca9d4dd2ee01-config\") pod \"kube-apiserver-proxy-ip-10-0-133-234.ec2.internal\" (UID: \"2df761e96899302463c4ca9d4dd2ee01\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.229650 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:01.229628 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jul 12 19:20:01.258885 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.258855 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6fba7a483df990721f423a08a6cb4680-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"6fba7a483df990721f423a08a6cb4680\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.258966 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.258894 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6fba7a483df990721f423a08a6cb4680-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"6fba7a483df990721f423a08a6cb4680\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.258966 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.258903 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fba7a483df990721f423a08a6cb4680-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"6fba7a483df990721f423a08a6cb4680\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.258966 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.258927 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2df761e96899302463c4ca9d4dd2ee01-config\") pod \"kube-apiserver-proxy-ip-10-0-133-234.ec2.internal\" (UID: \"2df761e96899302463c4ca9d4dd2ee01\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.259056 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.258965 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2df761e96899302463c4ca9d4dd2ee01-config\") pod \"kube-apiserver-proxy-ip-10-0-133-234.ec2.internal\" (UID: \"2df761e96899302463c4ca9d4dd2ee01\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.259056 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.258965 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fba7a483df990721f423a08a6cb4680-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"6fba7a483df990721f423a08a6cb4680\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.330182 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:01.330119 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jul 12 19:20:01.430738 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:01.430710 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jul 12 19:20:01.441910 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.441886 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.447102 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.447088 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" Jul 12 19:20:01.531329 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:01.531279 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jul 12 19:20:01.631881 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:01.631805 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jul 12 19:20:01.732397 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:01.732373 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jul 12 19:20:01.793949 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.793915 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 12 19:20:01.794510 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.794107 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 12 19:20:01.794510 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.794109 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 12 19:20:01.833472 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:01.833430 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jul 12 19:20:01.856247 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.856204 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-11 19:15:01 +0000 UTC" deadline="2027-12-06 18:39:56.872523522 +0000 UTC" Jul 12 19:20:01.856247 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:01.856236 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12287h19m55.016291866s" Jul 12 19:20:01.934392 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:01.934323 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jul 12 19:20:02.034659 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:02.034619 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jul 12 19:20:02.051675 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:02.051629 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df761e96899302463c4ca9d4dd2ee01.slice/crio-1aed905e9bda4a62e1f7bd9e563161eb015c1c385da44ddebe3348ef7c755123 WatchSource:0}: Error finding container 1aed905e9bda4a62e1f7bd9e563161eb015c1c385da44ddebe3348ef7c755123: Status 404 returned error can't find the container with id 1aed905e9bda4a62e1f7bd9e563161eb015c1c385da44ddebe3348ef7c755123 Jul 12 19:20:02.052289 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:02.052267 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fba7a483df990721f423a08a6cb4680.slice/crio-20f6ceca3eb28f14125c249d6d682ed454148842e0547b45b9db6fa160a50e62 WatchSource:0}: Error finding container 20f6ceca3eb28f14125c249d6d682ed454148842e0547b45b9db6fa160a50e62: Status 404 returned error can't find the container with id 20f6ceca3eb28f14125c249d6d682ed454148842e0547b45b9db6fa160a50e62 Jul 12 19:20:02.059327 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.059313 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 19:20:02.135740 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:02.135694 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jul 12 19:20:02.161707 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.161679 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 19:20:02.195443 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.195365 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 19:20:02.256896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.256857 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jul 12 19:20:02.268012 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.267980 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 12 19:20:02.269128 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.269114 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" Jul 12 19:20:02.277680 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.277657 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 12 19:20:02.833935 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.833907 2572 apiserver.go:52] "Watching apiserver" Jul 12 19:20:02.841703 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.841675 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 12 19:20:02.843299 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.843252 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-5t7x2","openshift-network-diagnostics/network-check-target-6z2hb","openshift-network-operator/iptables-alerter-qz8dx","kube-system/global-pull-secret-syncer-5pzz7","kube-system/konnectivity-agent-rsf7p","kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal","openshift-multus/multus-additional-cni-plugins-74nhl","openshift-ovn-kubernetes/ovnkube-node-9s2cn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm","openshift-cluster-node-tuning-operator/tuned-6bvft","openshift-dns/node-resolver-xwlc6","openshift-image-registry/node-ca-5pdfz","openshift-multus/multus-k9k2h"] Jul 12 19:20:02.844955 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.844931 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xwlc6" Jul 12 19:20:02.846112 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.846088 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:02.846237 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:02.846191 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:02.847548 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.847520 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qz8dx" Jul 12 19:20:02.850431 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.849036 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:02.850431 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:02.849121 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:02.850431 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.849333 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hz8mp\"" Jul 12 19:20:02.850431 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.849935 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 12 19:20:02.850680 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.850448 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 12 19:20:02.851026 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.851001 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 12 19:20:02.851438 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.851417 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 12 19:20:02.851666 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.851649 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 12 19:20:02.851898 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.851877 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bvf8d\"" Jul 12 19:20:02.855636 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.855616 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rsf7p" Jul 12 19:20:02.856334 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.856299 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.856492 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.856475 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 12 19:20:02.858108 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.857408 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5pdfz" Jul 12 19:20:02.858613 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.858432 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 12 19:20:02.858613 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.858549 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hlcb7\"" Jul 12 19:20:02.858910 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.858887 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:02.859000 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.858984 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 12 19:20:02.859403 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.859382 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 12 19:20:02.859586 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.859567 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 12 19:20:02.859729 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.859710 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kjbw5\"" Jul 12 19:20:02.859729 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.859708 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 12 19:20:02.859886 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.859567 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 12 19:20:02.860199 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.860178 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9gww8\"" Jul 12 19:20:02.860289 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.860178 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 12 19:20:02.860415 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.860394 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 12 19:20:02.860514 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.860492 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 12 19:20:02.860833 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.860814 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.861730 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.861710 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 12 19:20:02.861903 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.861887 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g8nj9\"" Jul 12 19:20:02.861984 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.861971 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 12 19:20:02.862251 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.862228 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:02.863748 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.863649 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 12 19:20:02.864141 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.864020 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 12 19:20:02.864141 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.864038 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:02.864603 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.864583 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 12 19:20:02.865813 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.865791 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 12 19:20:02.865924 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.865867 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xf5gf\"" Jul 12 19:20:02.866048 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.866028 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 12 19:20:02.866253 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.866221 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:02.866253 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.866239 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 12 19:20:02.866413 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:02.866289 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:02.866413 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.866350 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 12 19:20:02.866413 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.865793 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 12 19:20:02.866670 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.866641 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5b8j7\"" Jul 12 19:20:02.866670 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.866663 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 12 19:20:02.866942 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.866917 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 12 19:20:02.867073 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.866931 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 12 19:20:02.867371 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.867184 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g95ld\"" Jul 12 19:20:02.868707 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868419 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9hm4\" (UniqueName: \"kubernetes.io/projected/9b658735-f326-4144-a145-c33b84cff253-kube-api-access-r9hm4\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:02.868707 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868458 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-var-lib-cni-bin\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.868707 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868486 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-run-multus-certs\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.868707 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868511 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcvmg\" (UniqueName: \"kubernetes.io/projected/4495cbb3-2285-4359-a836-8130d15cc4b4-kube-api-access-gcvmg\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.868707 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:02.868707 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868561 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e895d844-4f9c-47d9-ae8b-de587d04c049-agent-certs\") pod \"konnectivity-agent-rsf7p\" (UID: \"e895d844-4f9c-47d9-ae8b-de587d04c049\") " pod="kube-system/konnectivity-agent-rsf7p" Jul 12 19:20:02.868707 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-run-netns\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.868707 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868608 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxp6r\" (UniqueName: \"kubernetes.io/projected/f3efc208-7053-4f82-bcc6-6ee65940f9c5-kube-api-access-sxp6r\") pod \"node-resolver-xwlc6\" (UID: \"f3efc208-7053-4f82-bcc6-6ee65940f9c5\") " pod="openshift-dns/node-resolver-xwlc6" Jul 12 19:20:02.868707 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e895d844-4f9c-47d9-ae8b-de587d04c049-konnectivity-ca\") pod \"konnectivity-agent-rsf7p\" (UID: \"e895d844-4f9c-47d9-ae8b-de587d04c049\") " pod="kube-system/konnectivity-agent-rsf7p" Jul 12 19:20:02.868707 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868658 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-multus-cni-dir\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.868707 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868701 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-os-release\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868735 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-var-lib-kubelet\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868761 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/177e5598-3546-4a59-aca8-47ea7fd504a3-host\") pod \"node-ca-5pdfz\" (UID: \"177e5598-3546-4a59-aca8-47ea7fd504a3\") " pod="openshift-image-registry/node-ca-5pdfz" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868787 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-cnibin\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868812 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-run-k8s-cni-cncf-io\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868838 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-var-lib-cni-multus\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868876 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3efc208-7053-4f82-bcc6-6ee65940f9c5-tmp-dir\") pod \"node-resolver-xwlc6\" (UID: \"f3efc208-7053-4f82-bcc6-6ee65940f9c5\") " pod="openshift-dns/node-resolver-xwlc6" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4495cbb3-2285-4359-a836-8130d15cc4b4-cni-binary-copy\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.868981 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-hostroot\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.869008 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-multus-conf-dir\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.869033 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4495cbb3-2285-4359-a836-8130d15cc4b4-multus-daemon-config\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.869055 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-etc-kubernetes\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.869101 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w9mr\" (UniqueName: \"kubernetes.io/projected/177e5598-3546-4a59-aca8-47ea7fd504a3-kube-api-access-5w9mr\") pod \"node-ca-5pdfz\" (UID: \"177e5598-3546-4a59-aca8-47ea7fd504a3\") " pod="openshift-image-registry/node-ca-5pdfz" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.869139 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-system-cni-dir\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.869165 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5w74\" (UniqueName: \"kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74\") pod \"network-check-target-6z2hb\" (UID: \"b3f58533-1ffa-468f-9f35-e16b38d920fb\") " pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.869197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e4992c6-020d-472a-8cb9-28c6fbf65101-iptables-alerter-script\") pod \"iptables-alerter-qz8dx\" (UID: \"9e4992c6-020d-472a-8cb9-28c6fbf65101\") " pod="openshift-network-operator/iptables-alerter-qz8dx" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.869221 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e4992c6-020d-472a-8cb9-28c6fbf65101-host-slash\") pod \"iptables-alerter-qz8dx\" (UID: \"9e4992c6-020d-472a-8cb9-28c6fbf65101\") " pod="openshift-network-operator/iptables-alerter-qz8dx" Jul 12 19:20:02.869362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.869266 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-multus-socket-dir-parent\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.870248 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.869291 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp8jd\" (UniqueName: \"kubernetes.io/projected/9e4992c6-020d-472a-8cb9-28c6fbf65101-kube-api-access-sp8jd\") pod \"iptables-alerter-qz8dx\" (UID: \"9e4992c6-020d-472a-8cb9-28c6fbf65101\") " pod="openshift-network-operator/iptables-alerter-qz8dx" Jul 12 19:20:02.870248 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.869352 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/177e5598-3546-4a59-aca8-47ea7fd504a3-serviceca\") pod \"node-ca-5pdfz\" (UID: \"177e5598-3546-4a59-aca8-47ea7fd504a3\") " pod="openshift-image-registry/node-ca-5pdfz" Jul 12 19:20:02.870248 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.869384 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3efc208-7053-4f82-bcc6-6ee65940f9c5-hosts-file\") pod \"node-resolver-xwlc6\" (UID: \"f3efc208-7053-4f82-bcc6-6ee65940f9c5\") " pod="openshift-dns/node-resolver-xwlc6" Jul 12 19:20:02.870248 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.870114 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 12 19:20:02.889522 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.889497 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-snwpw" Jul 12 19:20:02.896738 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.896715 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-snwpw" Jul 12 19:20:02.957629 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.957601 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 12 19:20:02.970259 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970217 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-sysctl-conf\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:02.970432 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970267 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/177e5598-3546-4a59-aca8-47ea7fd504a3-serviceca\") pod \"node-ca-5pdfz\" (UID: \"177e5598-3546-4a59-aca8-47ea7fd504a3\") " pod="openshift-image-registry/node-ca-5pdfz" Jul 12 19:20:02.970432 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970296 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb5a4a9e-03a6-417a-84f5-511c5278484f-ovnkube-script-lib\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.970432 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970321 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-lib-modules\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:02.970432 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970351 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9hm4\" (UniqueName: \"kubernetes.io/projected/9b658735-f326-4144-a145-c33b84cff253-kube-api-access-r9hm4\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:02.970432 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970395 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-run-ovn-kubernetes\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.970432 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970420 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-cni-netd\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.970766 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970443 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-system-cni-dir\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:02.970766 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970466 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-sysctl-d\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:02.970766 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970488 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-run-systemd\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.970766 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970513 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:02.970766 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970538 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhnh9\" (UniqueName: \"kubernetes.io/projected/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-kube-api-access-qhnh9\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:02.970766 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970565 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:02.970766 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970592 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxp6r\" (UniqueName: \"kubernetes.io/projected/f3efc208-7053-4f82-bcc6-6ee65940f9c5-kube-api-access-sxp6r\") pod \"node-resolver-xwlc6\" (UID: \"f3efc208-7053-4f82-bcc6-6ee65940f9c5\") " pod="openshift-dns/node-resolver-xwlc6" Jul 12 19:20:02.970766 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e895d844-4f9c-47d9-ae8b-de587d04c049-konnectivity-ca\") pod \"konnectivity-agent-rsf7p\" (UID: \"e895d844-4f9c-47d9-ae8b-de587d04c049\") " pod="kube-system/konnectivity-agent-rsf7p" Jul 12 19:20:02.970766 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970642 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-multus-cni-dir\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.970766 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970667 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-os-release\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.970766 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970692 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-run-ovn\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.970766 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970717 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-etc-selinux\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:02.970766 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-cnibin\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:02.970766 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970767 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-systemd\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970810 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-cnibin\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970837 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/177e5598-3546-4a59-aca8-47ea7fd504a3-serviceca\") pod \"node-ca-5pdfz\" (UID: \"177e5598-3546-4a59-aca8-47ea7fd504a3\") " pod="openshift-image-registry/node-ca-5pdfz" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970838 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-run-k8s-cni-cncf-io\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970904 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-log-socket\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.970964 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-cnibin\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971002 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971038 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-sysconfig\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971075 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4495cbb3-2285-4359-a836-8130d15cc4b4-cni-binary-copy\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971076 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-multus-cni-dir\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971081 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-run-k8s-cni-cncf-io\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971108 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-hostroot\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971136 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-multus-conf-dir\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971143 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-os-release\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971180 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4495cbb3-2285-4359-a836-8130d15cc4b4-multus-daemon-config\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971208 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-var-lib-openvswitch\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971233 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-cni-bin\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971259 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb5a4a9e-03a6-417a-84f5-511c5278484f-ovnkube-config\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.971335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971315 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-sys\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971341 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-system-cni-dir\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971398 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e4992c6-020d-472a-8cb9-28c6fbf65101-iptables-alerter-script\") pod \"iptables-alerter-qz8dx\" (UID: \"9e4992c6-020d-472a-8cb9-28c6fbf65101\") " pod="openshift-network-operator/iptables-alerter-qz8dx" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971439 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971446 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e895d844-4f9c-47d9-ae8b-de587d04c049-konnectivity-ca\") pod \"konnectivity-agent-rsf7p\" (UID: \"e895d844-4f9c-47d9-ae8b-de587d04c049\") " pod="kube-system/konnectivity-agent-rsf7p" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971475 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-var-lib-kubelet\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971507 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-host\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971534 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2c56f312-5f0b-47d4-a4be-1a366e433488-kubelet-config\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971571 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp8jd\" (UniqueName: \"kubernetes.io/projected/9e4992c6-020d-472a-8cb9-28c6fbf65101-kube-api-access-sp8jd\") pod \"iptables-alerter-qz8dx\" (UID: \"9e4992c6-020d-472a-8cb9-28c6fbf65101\") " pod="openshift-network-operator/iptables-alerter-qz8dx" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971594 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-tuned\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971624 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2c56f312-5f0b-47d4-a4be-1a366e433488-dbus\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971685 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3efc208-7053-4f82-bcc6-6ee65940f9c5-hosts-file\") pod \"node-resolver-xwlc6\" (UID: \"f3efc208-7053-4f82-bcc6-6ee65940f9c5\") " pod="openshift-dns/node-resolver-xwlc6" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971714 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-etc-openvswitch\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd4jg\" (UniqueName: \"kubernetes.io/projected/bb5a4a9e-03a6-417a-84f5-511c5278484f-kube-api-access-sd4jg\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971766 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-registration-dir\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971792 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-modprobe-d\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971824 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-var-lib-cni-bin\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.971969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971873 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-run-multus-certs\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971898 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcvmg\" (UniqueName: \"kubernetes.io/projected/4495cbb3-2285-4359-a836-8130d15cc4b4-kube-api-access-gcvmg\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971921 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971684 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4495cbb3-2285-4359-a836-8130d15cc4b4-cni-binary-copy\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971934 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e4992c6-020d-472a-8cb9-28c6fbf65101-iptables-alerter-script\") pod \"iptables-alerter-qz8dx\" (UID: \"9e4992c6-020d-472a-8cb9-28c6fbf65101\") " pod="openshift-network-operator/iptables-alerter-qz8dx" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971969 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-hostroot\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971993 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-run-multus-certs\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.971992 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-multus-conf-dir\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972017 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-device-dir\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972024 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3efc208-7053-4f82-bcc6-6ee65940f9c5-hosts-file\") pod \"node-resolver-xwlc6\" (UID: \"f3efc208-7053-4f82-bcc6-6ee65940f9c5\") " pod="openshift-dns/node-resolver-xwlc6" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972047 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-os-release\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972057 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-system-cni-dir\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972083 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-kubernetes\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972112 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1882662-bf07-45f4-81f6-ce2699b7dd1e-tmp\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972113 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-var-lib-cni-bin\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972141 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:02.972202 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:20:02.972858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972231 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e895d844-4f9c-47d9-ae8b-de587d04c049-agent-certs\") pod \"konnectivity-agent-rsf7p\" (UID: \"e895d844-4f9c-47d9-ae8b-de587d04c049\") " pod="kube-system/konnectivity-agent-rsf7p" Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:02.972252 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs podName:9b658735-f326-4144-a145-c33b84cff253 nodeName:}" failed. No retries permitted until 2026-07-12 19:20:03.472236792 +0000 UTC m=+3.006224948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs") pod "network-metrics-daemon-5t7x2" (UID: "9b658735-f326-4144-a145-c33b84cff253") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972283 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-run-netns\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972302 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972319 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb5a4a9e-03a6-417a-84f5-511c5278484f-ovn-node-metrics-cert\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972336 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-var-lib-kubelet\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972362 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-run-netns\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972395 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-var-lib-kubelet\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972355 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-run-netns\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972439 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-run-openvswitch\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972462 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-run\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972487 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdnzk\" (UniqueName: \"kubernetes.io/projected/c1882662-bf07-45f4-81f6-ce2699b7dd1e-kube-api-access-wdnzk\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972519 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/177e5598-3546-4a59-aca8-47ea7fd504a3-host\") pod \"node-ca-5pdfz\" (UID: \"177e5598-3546-4a59-aca8-47ea7fd504a3\") " pod="openshift-image-registry/node-ca-5pdfz" Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-var-lib-cni-multus\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972543 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4495cbb3-2285-4359-a836-8130d15cc4b4-multus-daemon-config\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972566 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-sys-fs\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:02.973565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972575 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/177e5598-3546-4a59-aca8-47ea7fd504a3-host\") pod \"node-ca-5pdfz\" (UID: \"177e5598-3546-4a59-aca8-47ea7fd504a3\") " pod="openshift-image-registry/node-ca-5pdfz" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972594 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3efc208-7053-4f82-bcc6-6ee65940f9c5-tmp-dir\") pod \"node-resolver-xwlc6\" (UID: \"f3efc208-7053-4f82-bcc6-6ee65940f9c5\") " pod="openshift-dns/node-resolver-xwlc6" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972595 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972619 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-etc-kubernetes\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972635 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-systemd-units\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-node-log\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972676 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-etc-kubernetes\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972694 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972599 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-host-var-lib-cni-multus\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972771 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w9mr\" (UniqueName: \"kubernetes.io/projected/177e5598-3546-4a59-aca8-47ea7fd504a3-kube-api-access-5w9mr\") pod \"node-ca-5pdfz\" (UID: \"177e5598-3546-4a59-aca8-47ea7fd504a3\") " pod="openshift-image-registry/node-ca-5pdfz" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972792 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5w74\" (UniqueName: \"kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74\") pod \"network-check-target-6z2hb\" (UID: \"b3f58533-1ffa-468f-9f35-e16b38d920fb\") " pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972813 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e4992c6-020d-472a-8cb9-28c6fbf65101-host-slash\") pod \"iptables-alerter-qz8dx\" (UID: \"9e4992c6-020d-472a-8cb9-28c6fbf65101\") " pod="openshift-network-operator/iptables-alerter-qz8dx" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972828 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-kubelet\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972843 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-slash\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972860 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zsn4\" (UniqueName: \"kubernetes.io/projected/c09b5347-531e-4f49-b90f-f65832132591-kube-api-access-5zsn4\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972877 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-multus-socket-dir-parent\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972900 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb5a4a9e-03a6-417a-84f5-511c5278484f-env-overrides\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:02.974388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.972924 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-socket-dir\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:02.975208 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.973016 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3efc208-7053-4f82-bcc6-6ee65940f9c5-tmp-dir\") pod \"node-resolver-xwlc6\" (UID: \"f3efc208-7053-4f82-bcc6-6ee65940f9c5\") " pod="openshift-dns/node-resolver-xwlc6" Jul 12 19:20:02.975208 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.973055 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e4992c6-020d-472a-8cb9-28c6fbf65101-host-slash\") pod \"iptables-alerter-qz8dx\" (UID: \"9e4992c6-020d-472a-8cb9-28c6fbf65101\") " pod="openshift-network-operator/iptables-alerter-qz8dx" Jul 12 19:20:02.975208 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.973117 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4495cbb3-2285-4359-a836-8130d15cc4b4-multus-socket-dir-parent\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.976392 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.976346 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e895d844-4f9c-47d9-ae8b-de587d04c049-agent-certs\") pod \"konnectivity-agent-rsf7p\" (UID: \"e895d844-4f9c-47d9-ae8b-de587d04c049\") " pod="kube-system/konnectivity-agent-rsf7p" Jul 12 19:20:02.981174 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:02.981148 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 19:20:02.981277 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:02.981178 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 19:20:02.981277 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:02.981194 2572 projected.go:196] Error preparing data for projected volume kube-api-access-g5w74 for pod openshift-network-diagnostics/network-check-target-6z2hb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:20:02.981277 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:02.981265 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74 podName:b3f58533-1ffa-468f-9f35-e16b38d920fb nodeName:}" failed. No retries permitted until 2026-07-12 19:20:03.481245355 +0000 UTC m=+3.015233535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g5w74" (UniqueName: "kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74") pod "network-check-target-6z2hb" (UID: "b3f58533-1ffa-468f-9f35-e16b38d920fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:20:02.984111 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.984080 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9hm4\" (UniqueName: \"kubernetes.io/projected/9b658735-f326-4144-a145-c33b84cff253-kube-api-access-r9hm4\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:02.984589 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.984544 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp8jd\" (UniqueName: \"kubernetes.io/projected/9e4992c6-020d-472a-8cb9-28c6fbf65101-kube-api-access-sp8jd\") pod \"iptables-alerter-qz8dx\" (UID: \"9e4992c6-020d-472a-8cb9-28c6fbf65101\") " pod="openshift-network-operator/iptables-alerter-qz8dx" Jul 12 19:20:02.984697 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.984675 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxp6r\" (UniqueName: \"kubernetes.io/projected/f3efc208-7053-4f82-bcc6-6ee65940f9c5-kube-api-access-sxp6r\") pod \"node-resolver-xwlc6\" (UID: \"f3efc208-7053-4f82-bcc6-6ee65940f9c5\") " pod="openshift-dns/node-resolver-xwlc6" Jul 12 19:20:02.985475 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.985452 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcvmg\" (UniqueName: \"kubernetes.io/projected/4495cbb3-2285-4359-a836-8130d15cc4b4-kube-api-access-gcvmg\") pod \"multus-k9k2h\" (UID: \"4495cbb3-2285-4359-a836-8130d15cc4b4\") " pod="openshift-multus/multus-k9k2h" Jul 12 19:20:02.987049 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:02.987010 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w9mr\" (UniqueName: \"kubernetes.io/projected/177e5598-3546-4a59-aca8-47ea7fd504a3-kube-api-access-5w9mr\") pod \"node-ca-5pdfz\" (UID: \"177e5598-3546-4a59-aca8-47ea7fd504a3\") " pod="openshift-image-registry/node-ca-5pdfz" Jul 12 19:20:03.011356 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.011279 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" event={"ID":"6fba7a483df990721f423a08a6cb4680","Type":"ContainerStarted","Data":"20f6ceca3eb28f14125c249d6d682ed454148842e0547b45b9db6fa160a50e62"} Jul 12 19:20:03.012832 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.012802 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" event={"ID":"2df761e96899302463c4ca9d4dd2ee01","Type":"ContainerStarted","Data":"1aed905e9bda4a62e1f7bd9e563161eb015c1c385da44ddebe3348ef7c755123"} Jul 12 19:20:03.073305 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073263 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-host\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.073454 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073330 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2c56f312-5f0b-47d4-a4be-1a366e433488-kubelet-config\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:03.073454 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073361 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-tuned\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.073454 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073386 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2c56f312-5f0b-47d4-a4be-1a366e433488-dbus\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:03.073454 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073399 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-host\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.073454 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073413 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-etc-openvswitch\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.073454 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073439 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd4jg\" (UniqueName: \"kubernetes.io/projected/bb5a4a9e-03a6-417a-84f5-511c5278484f-kube-api-access-sd4jg\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.073661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073463 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-registration-dir\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:03.073661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073487 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-modprobe-d\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.073661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073513 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:03.073661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073536 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-device-dir\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:03.073661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073552 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-os-release\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.073661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073567 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-kubernetes\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.073661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073583 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1882662-bf07-45f4-81f6-ce2699b7dd1e-tmp\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.073661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073610 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.073661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073626 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb5a4a9e-03a6-417a-84f5-511c5278484f-ovn-node-metrics-cert\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.073661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073643 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-run-netns\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.073661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073658 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-run-openvswitch\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.074005 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073674 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-run\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.074005 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073707 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdnzk\" (UniqueName: \"kubernetes.io/projected/c1882662-bf07-45f4-81f6-ce2699b7dd1e-kube-api-access-wdnzk\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.074005 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073725 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-sys-fs\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:03.074005 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073748 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-systemd-units\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.074005 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073759 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2c56f312-5f0b-47d4-a4be-1a366e433488-kubelet-config\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:03.074005 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073813 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2c56f312-5f0b-47d4-a4be-1a366e433488-dbus\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:03.074005 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073861 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.074005 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073769 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-node-log\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.074005 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073905 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.074005 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-kubelet\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.074005 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-slash\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.074005 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074002 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zsn4\" (UniqueName: \"kubernetes.io/projected/c09b5347-531e-4f49-b90f-f65832132591-kube-api-access-5zsn4\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074031 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb5a4a9e-03a6-417a-84f5-511c5278484f-env-overrides\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074057 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-socket-dir\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074082 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-sysctl-conf\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074109 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb5a4a9e-03a6-417a-84f5-511c5278484f-ovnkube-script-lib\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074135 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-lib-modules\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-run-ovn-kubernetes\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074201 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-cni-netd\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074226 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-system-cni-dir\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074253 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-sysctl-d\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074277 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-run-systemd\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074303 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074357 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-kubelet\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074423 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhnh9\" (UniqueName: \"kubernetes.io/projected/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-kube-api-access-qhnh9\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074460 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074479 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-systemd-units\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-run-ovn\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.074623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074530 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-etc-selinux\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074534 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-kubernetes\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074556 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-cnibin\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074583 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-systemd\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074611 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-log-socket\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074667 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-log-socket\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074713 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-etc-openvswitch\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074766 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-lib-modules\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074814 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074850 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-sysconfig\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074887 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-var-lib-openvswitch\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-cni-bin\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074940 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb5a4a9e-03a6-417a-84f5-511c5278484f-ovnkube-config\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074967 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-sys\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074968 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-registration-dir\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.074998 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075028 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-var-lib-kubelet\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.075506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075077 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-modprobe-d\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075125 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075127 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-var-lib-kubelet\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075140 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075173 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-device-dir\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075177 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-run-ovn-kubernetes\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.073816 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-node-log\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075210 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb5a4a9e-03a6-417a-84f5-511c5278484f-ovnkube-script-lib\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075232 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-var-lib-openvswitch\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075237 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-run\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075247 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-os-release\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075259 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-slash\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075263 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-cni-netd\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075294 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-cni-bin\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075310 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-sys\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075572 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb5a4a9e-03a6-417a-84f5-511c5278484f-env-overrides\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075621 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-sys-fs\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:03.076452 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:03.075622 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:03.075683 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret podName:2c56f312-5f0b-47d4-a4be-1a366e433488 nodeName:}" failed. No retries permitted until 2026-07-12 19:20:03.575662942 +0000 UTC m=+3.109651097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret") pod "global-pull-secret-syncer-5pzz7" (UID: "2c56f312-5f0b-47d4-a4be-1a366e433488") : object "kube-system"/"original-pull-secret" not registered Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075700 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-socket-dir\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075792 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075796 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-sysctl-conf\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075826 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-host-run-netns\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075874 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-cnibin\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075876 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-run-ovn\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075885 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-run-systemd\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075930 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-system-cni-dir\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075935 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c09b5347-531e-4f49-b90f-f65832132591-etc-selinux\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.075963 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-sysconfig\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.076007 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.076034 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-sysctl-d\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.076040 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.076071 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-systemd\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.077053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.076077 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb5a4a9e-03a6-417a-84f5-511c5278484f-run-openvswitch\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.077674 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.076354 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c1882662-bf07-45f4-81f6-ce2699b7dd1e-etc-tuned\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.077674 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.076428 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb5a4a9e-03a6-417a-84f5-511c5278484f-ovnkube-config\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.078687 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.078662 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1882662-bf07-45f4-81f6-ce2699b7dd1e-tmp\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.080004 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.079984 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb5a4a9e-03a6-417a-84f5-511c5278484f-ovn-node-metrics-cert\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.083338 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.083297 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdnzk\" (UniqueName: \"kubernetes.io/projected/c1882662-bf07-45f4-81f6-ce2699b7dd1e-kube-api-access-wdnzk\") pod \"tuned-6bvft\" (UID: \"c1882662-bf07-45f4-81f6-ce2699b7dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.083463 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.083443 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd4jg\" (UniqueName: \"kubernetes.io/projected/bb5a4a9e-03a6-417a-84f5-511c5278484f-kube-api-access-sd4jg\") pod \"ovnkube-node-9s2cn\" (UID: \"bb5a4a9e-03a6-417a-84f5-511c5278484f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.084711 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.084658 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhnh9\" (UniqueName: \"kubernetes.io/projected/b8808a46-de8e-4f1d-b36a-eb8d99b160b3-kube-api-access-qhnh9\") pod \"multus-additional-cni-plugins-74nhl\" (UID: \"b8808a46-de8e-4f1d-b36a-eb8d99b160b3\") " pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.084819 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.084713 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zsn4\" (UniqueName: \"kubernetes.io/projected/c09b5347-531e-4f49-b90f-f65832132591-kube-api-access-5zsn4\") pod \"aws-ebs-csi-driver-node-fvmcm\" (UID: \"c09b5347-531e-4f49-b90f-f65832132591\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:03.160485 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.160458 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xwlc6" Jul 12 19:20:03.171459 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.171434 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qz8dx" Jul 12 19:20:03.182396 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.182369 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rsf7p" Jul 12 19:20:03.191375 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.191353 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9k2h" Jul 12 19:20:03.199278 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.199258 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5pdfz" Jul 12 19:20:03.207384 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.207365 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-74nhl" Jul 12 19:20:03.215442 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.215423 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:03.231220 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.231196 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" Jul 12 19:20:03.238179 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.238158 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6bvft" Jul 12 19:20:03.322347 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.322318 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 19:20:03.393318 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.393220 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 19:20:03.479426 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.479385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:03.479623 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:03.479532 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:20:03.479623 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:03.479606 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs podName:9b658735-f326-4144-a145-c33b84cff253 nodeName:}" failed. No retries permitted until 2026-07-12 19:20:04.479586602 +0000 UTC m=+4.013574776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs") pod "network-metrics-daemon-5t7x2" (UID: "9b658735-f326-4144-a145-c33b84cff253") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:20:03.579712 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.579681 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5w74\" (UniqueName: \"kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74\") pod \"network-check-target-6z2hb\" (UID: \"b3f58533-1ffa-468f-9f35-e16b38d920fb\") " pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:03.579891 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.579727 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:03.579891 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:03.579858 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 19:20:03.579891 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:03.579873 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 19:20:03.579891 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:03.579891 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 19:20:03.580057 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:03.579907 2572 projected.go:196] Error preparing data for projected volume kube-api-access-g5w74 for pod openshift-network-diagnostics/network-check-target-6z2hb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:20:03.580057 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:03.579932 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret podName:2c56f312-5f0b-47d4-a4be-1a366e433488 nodeName:}" failed. No retries permitted until 2026-07-12 19:20:04.579911025 +0000 UTC m=+4.113899183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret") pod "global-pull-secret-syncer-5pzz7" (UID: "2c56f312-5f0b-47d4-a4be-1a366e433488") : object "kube-system"/"original-pull-secret" not registered Jul 12 19:20:03.580057 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:03.579949 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74 podName:b3f58533-1ffa-468f-9f35-e16b38d920fb nodeName:}" failed. No retries permitted until 2026-07-12 19:20:04.579938317 +0000 UTC m=+4.113926490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5w74" (UniqueName: "kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74") pod "network-check-target-6z2hb" (UID: "b3f58533-1ffa-468f-9f35-e16b38d920fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:20:03.898976 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.898813 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 19:15:03 +0000 UTC" deadline="2028-01-27 22:39:51.934143537 +0000 UTC" Jul 12 19:20:03.898976 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:03.898915 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13539h19m48.035236706s" Jul 12 19:20:04.006130 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:04.006044 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:04.006274 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:04.006186 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:04.070899 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:04.070781 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a4a9e_03a6_417a_84f5_511c5278484f.slice/crio-fe48550909bdfcfc0fdb7faefff4a3aaec2ab4e2941136699bb08278ef568bda WatchSource:0}: Error finding container fe48550909bdfcfc0fdb7faefff4a3aaec2ab4e2941136699bb08278ef568bda: Status 404 returned error can't find the container with id fe48550909bdfcfc0fdb7faefff4a3aaec2ab4e2941136699bb08278ef568bda Jul 12 19:20:04.073661 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:04.073559 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3efc208_7053_4f82_bcc6_6ee65940f9c5.slice/crio-b7282f75fa7920e15dcc36d586fcb64efe3899ae434bb095679a7855ada9b1af WatchSource:0}: Error finding container b7282f75fa7920e15dcc36d586fcb64efe3899ae434bb095679a7855ada9b1af: Status 404 returned error can't find the container with id b7282f75fa7920e15dcc36d586fcb64efe3899ae434bb095679a7855ada9b1af Jul 12 19:20:04.076175 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:04.076115 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode895d844_4f9c_47d9_ae8b_de587d04c049.slice/crio-4f88f149bea820bc0181c2b736ed1489f34eff10fdf4b47a0c37cf02aa474885 WatchSource:0}: Error finding container 4f88f149bea820bc0181c2b736ed1489f34eff10fdf4b47a0c37cf02aa474885: Status 404 returned error can't find the container with id 4f88f149bea820bc0181c2b736ed1489f34eff10fdf4b47a0c37cf02aa474885 Jul 12 19:20:04.077853 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:04.077832 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8808a46_de8e_4f1d_b36a_eb8d99b160b3.slice/crio-0f3dfe2c5c76bd09659f14292f9ee882e16e3e421337f5b035545d7797294769 WatchSource:0}: Error finding container 0f3dfe2c5c76bd09659f14292f9ee882e16e3e421337f5b035545d7797294769: Status 404 returned error can't find the container with id 0f3dfe2c5c76bd09659f14292f9ee882e16e3e421337f5b035545d7797294769 Jul 12 19:20:04.079048 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:04.079004 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod177e5598_3546_4a59_aca8_47ea7fd504a3.slice/crio-31998ae40e76bf533b8152728534ffef0e99fc0c0d68de4ef5101e8c5bd27bb3 WatchSource:0}: Error finding container 31998ae40e76bf533b8152728534ffef0e99fc0c0d68de4ef5101e8c5bd27bb3: Status 404 returned error can't find the container with id 31998ae40e76bf533b8152728534ffef0e99fc0c0d68de4ef5101e8c5bd27bb3 Jul 12 19:20:04.092608 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:04.092500 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e4992c6_020d_472a_8cb9_28c6fbf65101.slice/crio-b1628e840f9aecab9b3a0051654c9681707b0037a89e21b699ad6e05234c494e WatchSource:0}: Error finding container b1628e840f9aecab9b3a0051654c9681707b0037a89e21b699ad6e05234c494e: Status 404 returned error can't find the container with id b1628e840f9aecab9b3a0051654c9681707b0037a89e21b699ad6e05234c494e Jul 12 19:20:04.093249 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:04.093227 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1882662_bf07_45f4_81f6_ce2699b7dd1e.slice/crio-2961d02c9a305a13bfa7a6b7a6a86b3f923b980a6eb4e7c032b8d0e36b7b8d60 WatchSource:0}: Error finding container 2961d02c9a305a13bfa7a6b7a6a86b3f923b980a6eb4e7c032b8d0e36b7b8d60: Status 404 returned error can't find the container with id 2961d02c9a305a13bfa7a6b7a6a86b3f923b980a6eb4e7c032b8d0e36b7b8d60 Jul 12 19:20:04.095258 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:04.095237 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4495cbb3_2285_4359_a836_8130d15cc4b4.slice/crio-987e11b94398627d9cd3b93392769fd7ff5bafc97db5b169f081369eb0840603 WatchSource:0}: Error finding container 987e11b94398627d9cd3b93392769fd7ff5bafc97db5b169f081369eb0840603: Status 404 returned error can't find the container with id 987e11b94398627d9cd3b93392769fd7ff5bafc97db5b169f081369eb0840603 Jul 12 19:20:04.095813 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:04.095790 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc09b5347_531e_4f49_b90f_f65832132591.slice/crio-99d5afbb0adfc04b8a8e917f183f7cd0d4b3558b8e38303572857d44f0686865 WatchSource:0}: Error finding container 99d5afbb0adfc04b8a8e917f183f7cd0d4b3558b8e38303572857d44f0686865: Status 404 returned error can't find the container with id 99d5afbb0adfc04b8a8e917f183f7cd0d4b3558b8e38303572857d44f0686865 Jul 12 19:20:04.486773 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:04.486569 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:04.486940 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:04.486721 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:20:04.486940 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:04.486852 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs podName:9b658735-f326-4144-a145-c33b84cff253 nodeName:}" failed. No retries permitted until 2026-07-12 19:20:06.486835895 +0000 UTC m=+6.020824049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs") pod "network-metrics-daemon-5t7x2" (UID: "9b658735-f326-4144-a145-c33b84cff253") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:20:04.587591 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:04.587490 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5w74\" (UniqueName: \"kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74\") pod \"network-check-target-6z2hb\" (UID: \"b3f58533-1ffa-468f-9f35-e16b38d920fb\") " pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:04.587591 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:04.587550 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:04.587823 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:04.587689 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 19:20:04.587823 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:04.587749 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret podName:2c56f312-5f0b-47d4-a4be-1a366e433488 nodeName:}" failed. No retries permitted until 2026-07-12 19:20:06.587729096 +0000 UTC m=+6.121717256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret") pod "global-pull-secret-syncer-5pzz7" (UID: "2c56f312-5f0b-47d4-a4be-1a366e433488") : object "kube-system"/"original-pull-secret" not registered Jul 12 19:20:04.588104 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:04.588085 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 19:20:04.588191 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:04.588113 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 19:20:04.588191 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:04.588127 2572 projected.go:196] Error preparing data for projected volume kube-api-access-g5w74 for pod openshift-network-diagnostics/network-check-target-6z2hb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:20:04.588191 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:04.588172 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74 podName:b3f58533-1ffa-468f-9f35-e16b38d920fb nodeName:}" failed. No retries permitted until 2026-07-12 19:20:06.588156536 +0000 UTC m=+6.122144694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5w74" (UniqueName: "kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74") pod "network-check-target-6z2hb" (UID: "b3f58533-1ffa-468f-9f35-e16b38d920fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:20:04.899940 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:04.899860 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 19:15:03 +0000 UTC" deadline="2028-01-17 18:24:07.299486833 +0000 UTC" Jul 12 19:20:04.899940 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:04.899900 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13295h4m2.399592121s" Jul 12 19:20:05.006538 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:05.006498 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:05.006729 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:05.006648 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:05.009050 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:05.008859 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:05.009050 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:05.008966 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:05.021200 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:05.021167 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5pdfz" event={"ID":"177e5598-3546-4a59-aca8-47ea7fd504a3","Type":"ContainerStarted","Data":"31998ae40e76bf533b8152728534ffef0e99fc0c0d68de4ef5101e8c5bd27bb3"} Jul 12 19:20:05.026823 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:05.026791 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xwlc6" event={"ID":"f3efc208-7053-4f82-bcc6-6ee65940f9c5","Type":"ContainerStarted","Data":"b7282f75fa7920e15dcc36d586fcb64efe3899ae434bb095679a7855ada9b1af"} Jul 12 19:20:05.029026 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:05.028996 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" event={"ID":"bb5a4a9e-03a6-417a-84f5-511c5278484f","Type":"ContainerStarted","Data":"fe48550909bdfcfc0fdb7faefff4a3aaec2ab4e2941136699bb08278ef568bda"} Jul 12 19:20:05.037814 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:05.037767 2572 generic.go:356] "Generic (PLEG): container finished" podID="6fba7a483df990721f423a08a6cb4680" containerID="ee05412001b81d4f8bc8de6f2210187432e6dbfd4f806b30ceb939d99f51b12a" exitCode=0 Jul 12 19:20:05.038482 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:05.038447 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" event={"ID":"6fba7a483df990721f423a08a6cb4680","Type":"ContainerDied","Data":"ee05412001b81d4f8bc8de6f2210187432e6dbfd4f806b30ceb939d99f51b12a"} Jul 12 19:20:05.048685 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:05.048656 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9k2h" event={"ID":"4495cbb3-2285-4359-a836-8130d15cc4b4","Type":"ContainerStarted","Data":"987e11b94398627d9cd3b93392769fd7ff5bafc97db5b169f081369eb0840603"} Jul 12 19:20:05.083554 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:05.083514 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74nhl" event={"ID":"b8808a46-de8e-4f1d-b36a-eb8d99b160b3","Type":"ContainerStarted","Data":"0f3dfe2c5c76bd09659f14292f9ee882e16e3e421337f5b035545d7797294769"} Jul 12 19:20:05.102093 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:05.102056 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rsf7p" event={"ID":"e895d844-4f9c-47d9-ae8b-de587d04c049","Type":"ContainerStarted","Data":"4f88f149bea820bc0181c2b736ed1489f34eff10fdf4b47a0c37cf02aa474885"} Jul 12 19:20:05.125764 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:05.125730 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" event={"ID":"2df761e96899302463c4ca9d4dd2ee01","Type":"ContainerStarted","Data":"59047d9094bdf5b3ecc6630a28c8c267b55753363d633c8052d828ab950e659d"} Jul 12 19:20:05.137712 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:05.137674 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6bvft" event={"ID":"c1882662-bf07-45f4-81f6-ce2699b7dd1e","Type":"ContainerStarted","Data":"2961d02c9a305a13bfa7a6b7a6a86b3f923b980a6eb4e7c032b8d0e36b7b8d60"} Jul 12 19:20:05.141074 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:05.140734 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" podStartSLOduration=2.140714644 podStartE2EDuration="2.140714644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:20:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:20:05.139892067 +0000 UTC m=+4.673880248" watchObservedRunningTime="2026-07-12 19:20:05.140714644 +0000 UTC m=+4.674702823" Jul 12 19:20:05.156978 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:05.156834 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" event={"ID":"c09b5347-531e-4f49-b90f-f65832132591","Type":"ContainerStarted","Data":"99d5afbb0adfc04b8a8e917f183f7cd0d4b3558b8e38303572857d44f0686865"} Jul 12 19:20:05.176666 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:05.176602 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qz8dx" event={"ID":"9e4992c6-020d-472a-8cb9-28c6fbf65101","Type":"ContainerStarted","Data":"b1628e840f9aecab9b3a0051654c9681707b0037a89e21b699ad6e05234c494e"} Jul 12 19:20:06.005914 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:06.005373 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:06.005914 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:06.005536 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:06.187902 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:06.187862 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" event={"ID":"6fba7a483df990721f423a08a6cb4680","Type":"ContainerStarted","Data":"ce2cbf2e3227d10e73edeb01909385cf1f08254c14591b1199c401e5ca996c30"} Jul 12 19:20:06.508613 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:06.508369 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:06.508613 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:06.508525 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:20:06.508613 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:06.508597 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs podName:9b658735-f326-4144-a145-c33b84cff253 nodeName:}" failed. No retries permitted until 2026-07-12 19:20:10.508574834 +0000 UTC m=+10.042563008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs") pod "network-metrics-daemon-5t7x2" (UID: "9b658735-f326-4144-a145-c33b84cff253") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:20:06.612750 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:06.612481 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5w74\" (UniqueName: \"kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74\") pod \"network-check-target-6z2hb\" (UID: \"b3f58533-1ffa-468f-9f35-e16b38d920fb\") " pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:06.612750 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:06.612553 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:06.612750 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:06.612754 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 19:20:06.612990 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:06.612827 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret podName:2c56f312-5f0b-47d4-a4be-1a366e433488 nodeName:}" failed. No retries permitted until 2026-07-12 19:20:10.612806209 +0000 UTC m=+10.146794367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret") pod "global-pull-secret-syncer-5pzz7" (UID: "2c56f312-5f0b-47d4-a4be-1a366e433488") : object "kube-system"/"original-pull-secret" not registered Jul 12 19:20:06.613313 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:06.613297 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 19:20:06.613396 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:06.613324 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 19:20:06.613396 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:06.613340 2572 projected.go:196] Error preparing data for projected volume kube-api-access-g5w74 for pod openshift-network-diagnostics/network-check-target-6z2hb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:20:06.613463 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:06.613404 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74 podName:b3f58533-1ffa-468f-9f35-e16b38d920fb nodeName:}" failed. No retries permitted until 2026-07-12 19:20:10.613387455 +0000 UTC m=+10.147375613 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5w74" (UniqueName: "kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74") pod "network-check-target-6z2hb" (UID: "b3f58533-1ffa-468f-9f35-e16b38d920fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:20:07.009604 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:07.009572 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:07.010104 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:07.009766 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:07.010273 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:07.010252 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:07.010402 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:07.010377 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:08.005487 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:08.005447 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:08.005692 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:08.005596 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:09.008640 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:09.008169 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:09.008640 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:09.008272 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:09.008640 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:09.008461 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:09.008640 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:09.008587 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:10.006092 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:10.006052 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:10.006273 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:10.006213 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:10.546758 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:10.546715 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:10.547224 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:10.546835 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:20:10.547224 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:10.546892 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs podName:9b658735-f326-4144-a145-c33b84cff253 nodeName:}" failed. No retries permitted until 2026-07-12 19:20:18.546876748 +0000 UTC m=+18.080864904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs") pod "network-metrics-daemon-5t7x2" (UID: "9b658735-f326-4144-a145-c33b84cff253") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:20:10.647883 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:10.647843 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5w74\" (UniqueName: \"kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74\") pod \"network-check-target-6z2hb\" (UID: \"b3f58533-1ffa-468f-9f35-e16b38d920fb\") " pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:10.648066 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:10.647910 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:10.648066 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:10.648026 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 19:20:10.648179 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:10.648113 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret podName:2c56f312-5f0b-47d4-a4be-1a366e433488 nodeName:}" failed. No retries permitted until 2026-07-12 19:20:18.64809146 +0000 UTC m=+18.182079622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret") pod "global-pull-secret-syncer-5pzz7" (UID: "2c56f312-5f0b-47d4-a4be-1a366e433488") : object "kube-system"/"original-pull-secret" not registered Jul 12 19:20:10.648179 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:10.648029 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 19:20:10.648179 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:10.648149 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 19:20:10.648179 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:10.648161 2572 projected.go:196] Error preparing data for projected volume kube-api-access-g5w74 for pod openshift-network-diagnostics/network-check-target-6z2hb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:20:10.648447 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:10.648203 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74 podName:b3f58533-1ffa-468f-9f35-e16b38d920fb nodeName:}" failed. No retries permitted until 2026-07-12 19:20:18.648190279 +0000 UTC m=+18.182178435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5w74" (UniqueName: "kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74") pod "network-check-target-6z2hb" (UID: "b3f58533-1ffa-468f-9f35-e16b38d920fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:20:11.007132 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:11.006409 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:11.007132 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:11.006537 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:11.007132 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:11.006994 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:11.007132 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:11.007088 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:12.006893 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:12.006330 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:12.006893 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:12.006507 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:13.006064 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:13.006031 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:13.006309 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:13.006172 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:13.006644 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:13.006564 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:13.006762 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:13.006662 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:14.006184 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:14.006148 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:14.020795 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:14.020738 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:15.005545 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:15.005508 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:15.005717 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:15.005507 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:15.005717 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:15.005628 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:15.005717 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:15.005694 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:16.006222 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:16.006181 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:16.006589 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:16.006315 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:17.005551 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:17.005515 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:17.005706 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:17.005564 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:17.005706 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:17.005653 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:17.006097 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:17.006073 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:18.005769 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:18.005736 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:18.006274 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:18.005864 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:18.615506 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:18.615469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:18.615650 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:18.615603 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:20:18.615713 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:18.615669 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs podName:9b658735-f326-4144-a145-c33b84cff253 nodeName:}" failed. No retries permitted until 2026-07-12 19:20:34.615648874 +0000 UTC m=+34.149637034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs") pod "network-metrics-daemon-5t7x2" (UID: "9b658735-f326-4144-a145-c33b84cff253") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:20:18.716220 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:18.716186 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5w74\" (UniqueName: \"kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74\") pod \"network-check-target-6z2hb\" (UID: \"b3f58533-1ffa-468f-9f35-e16b38d920fb\") " pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:18.716413 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:18.716232 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:18.716413 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:18.716355 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 19:20:18.716413 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:18.716373 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 19:20:18.716413 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:18.716399 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 19:20:18.716413 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:18.716407 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret podName:2c56f312-5f0b-47d4-a4be-1a366e433488 nodeName:}" failed. No retries permitted until 2026-07-12 19:20:34.716392602 +0000 UTC m=+34.250380755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret") pod "global-pull-secret-syncer-5pzz7" (UID: "2c56f312-5f0b-47d4-a4be-1a366e433488") : object "kube-system"/"original-pull-secret" not registered Jul 12 19:20:18.716413 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:18.716411 2572 projected.go:196] Error preparing data for projected volume kube-api-access-g5w74 for pod openshift-network-diagnostics/network-check-target-6z2hb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:20:18.716684 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:18.716460 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74 podName:b3f58533-1ffa-468f-9f35-e16b38d920fb nodeName:}" failed. No retries permitted until 2026-07-12 19:20:34.716447422 +0000 UTC m=+34.250435576 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5w74" (UniqueName: "kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74") pod "network-check-target-6z2hb" (UID: "b3f58533-1ffa-468f-9f35-e16b38d920fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:20:19.006178 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:19.006142 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:19.006606 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:19.006142 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:19.006606 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:19.006275 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:19.006606 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:19.006353 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:20.005891 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:20.005813 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:20.006028 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:20.005944 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:21.006343 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:21.006305 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:21.006806 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:21.006418 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:21.006806 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:21.006468 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:21.006806 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:21.006585 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:22.005694 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:22.005661 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:22.005856 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:22.005808 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:23.006362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:23.006331 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:23.006916 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:23.006332 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:23.006916 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:23.006457 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:23.006916 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:23.006544 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:24.006319 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.005940 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:24.006319 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:24.006260 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:24.224088 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.223906 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" event={"ID":"bb5a4a9e-03a6-417a-84f5-511c5278484f","Type":"ContainerStarted","Data":"972b29e9e5a51a6dce6ff5b0ad52cbe888252efc60bfb14934d1e84010c87966"} Jul 12 19:20:24.224260 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.224151 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" event={"ID":"bb5a4a9e-03a6-417a-84f5-511c5278484f","Type":"ContainerStarted","Data":"0ec1fb18ec1307ae512880377bd1bf3c76c17741130e51dd54b6f856c901d36f"} Jul 12 19:20:24.225522 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.225490 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9k2h" event={"ID":"4495cbb3-2285-4359-a836-8130d15cc4b4","Type":"ContainerStarted","Data":"62fdc60613bc232663d9fafa686954bd023cb1595a255b10ff1c3161be5b936a"} Jul 12 19:20:24.227061 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.227030 2572 generic.go:356] "Generic (PLEG): container finished" podID="b8808a46-de8e-4f1d-b36a-eb8d99b160b3" containerID="da63571d5eefedbf9347733b8628dde0c4df4e744c514a32afa1db646be1e602" exitCode=0 Jul 12 19:20:24.227155 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.227131 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74nhl" event={"ID":"b8808a46-de8e-4f1d-b36a-eb8d99b160b3","Type":"ContainerDied","Data":"da63571d5eefedbf9347733b8628dde0c4df4e744c514a32afa1db646be1e602"} Jul 12 19:20:24.228788 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.228769 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rsf7p" event={"ID":"e895d844-4f9c-47d9-ae8b-de587d04c049","Type":"ContainerStarted","Data":"bd9f383911a3df4bbfa6c35f9aa6067d1e23f17bbce9e5b1a7b3f049efbdb24b"} Jul 12 19:20:24.230433 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.230366 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6bvft" event={"ID":"c1882662-bf07-45f4-81f6-ce2699b7dd1e","Type":"ContainerStarted","Data":"44e195a7ab1769cb4725f36883d06cbbdab81d1d8bee0ebb0aa7dd7ddee4633e"} Jul 12 19:20:24.231858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.231837 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" event={"ID":"c09b5347-531e-4f49-b90f-f65832132591","Type":"ContainerStarted","Data":"3a4ab82a09b186f3f8686fc510038185971e29e391c2366b9407117ba9626837"} Jul 12 19:20:24.233349 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.233322 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5pdfz" event={"ID":"177e5598-3546-4a59-aca8-47ea7fd504a3","Type":"ContainerStarted","Data":"141ecd12112c675542a6a214ce0083b6c32cfc13fac85e0f49bc35fcf5cb8b69"} Jul 12 19:20:24.234731 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.234712 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xwlc6" event={"ID":"f3efc208-7053-4f82-bcc6-6ee65940f9c5","Type":"ContainerStarted","Data":"de7f4ef859548fa3d3e9509c4f985097509931b103064cf657b11d4136352130"} Jul 12 19:20:24.249415 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.248571 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" podStartSLOduration=21.24855263 podStartE2EDuration="21.24855263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:20:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:20:06.20438842 +0000 UTC m=+5.738376601" watchObservedRunningTime="2026-07-12 19:20:24.24855263 +0000 UTC m=+23.782540816" Jul 12 19:20:24.271473 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.271432 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xwlc6" podStartSLOduration=3.485760709 podStartE2EDuration="23.271418123s" totalImagesPullingTime="19.785657414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:20:24.270925937 +0000 UTC m=+23.804914109" watchObservedRunningTime="2026-07-12 19:20:24.271418123 +0000 UTC m=+23.805406297" Jul 12 19:20:24.271575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.271528 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k9k2h" podStartSLOduration=3.426939282 podStartE2EDuration="23.271523975s" totalImagesPullingTime="19.844584693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:20:24.250133737 +0000 UTC m=+23.784121907" watchObservedRunningTime="2026-07-12 19:20:24.271523975 +0000 UTC m=+23.805512144" Jul 12 19:20:24.285191 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.285142 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rsf7p" podStartSLOduration=7.690073042 podStartE2EDuration="23.285122531s" totalImagesPullingTime="15.595049489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:20:24.284855339 +0000 UTC m=+23.818843513" watchObservedRunningTime="2026-07-12 19:20:24.285122531 +0000 UTC m=+23.819110706" Jul 12 19:20:24.301688 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.301503 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5pdfz" podStartSLOduration=3.528630158 podStartE2EDuration="23.301489612s" totalImagesPullingTime="19.772859454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:20:24.301223726 +0000 UTC m=+23.835211902" watchObservedRunningTime="2026-07-12 19:20:24.301489612 +0000 UTC m=+23.835477840" Jul 12 19:20:24.360782 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:24.360724 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6bvft" podStartSLOduration=3.572788706 podStartE2EDuration="23.360702904s" totalImagesPullingTime="19.787914198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:20:24.360170508 +0000 UTC m=+23.894158683" watchObservedRunningTime="2026-07-12 19:20:24.360702904 +0000 UTC m=+23.894691079" Jul 12 19:20:25.005918 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:25.005886 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:25.005918 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:25.005901 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:25.006161 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:25.006021 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:25.006161 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:25.006107 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:25.238492 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:25.238464 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qz8dx" event={"ID":"9e4992c6-020d-472a-8cb9-28c6fbf65101","Type":"ContainerStarted","Data":"822db3c72021ec9a179872271754deabb2f148bd536849b627183155f6cab245"} Jul 12 19:20:25.241817 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:25.241791 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" event={"ID":"bb5a4a9e-03a6-417a-84f5-511c5278484f","Type":"ContainerStarted","Data":"815ddbf61ae7e1655b739ddd7bee9fca40ca0ced60e1ef16608d47834fdd3a96"} Jul 12 19:20:25.241906 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:25.241859 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" event={"ID":"bb5a4a9e-03a6-417a-84f5-511c5278484f","Type":"ContainerStarted","Data":"6ff3eecb17bb23eb4b98e11659bd002a5a4be916f7863ac06201d4de2cffe80b"} Jul 12 19:20:25.241953 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:25.241905 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" event={"ID":"bb5a4a9e-03a6-417a-84f5-511c5278484f","Type":"ContainerStarted","Data":"38e954657179a3dbd0324ca8b065cbdb8a541cc8e282ec1f9d2c06903456a9d3"} Jul 12 19:20:25.242002 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:25.241952 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" event={"ID":"bb5a4a9e-03a6-417a-84f5-511c5278484f","Type":"ContainerStarted","Data":"6bfaf38d385d3e7cfca7b4bde256c5cc8a052912029c1735220e26b79da38d6e"} Jul 12 19:20:25.364085 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:25.364055 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 12 19:20:25.928222 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:25.928110 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-12T19:20:25.364080046Z","UUID":"3366df73-46d0-40c9-9963-86fcbfe93553","Handler":null,"Name":"","Endpoint":""} Jul 12 19:20:25.933734 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:25.933703 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 12 19:20:25.933951 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:25.933934 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 12 19:20:26.005916 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:26.005885 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:26.006084 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:26.006025 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:26.246993 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:26.246901 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" event={"ID":"c09b5347-531e-4f49-b90f-f65832132591","Type":"ContainerStarted","Data":"9f39d6b67844958f69cbe1b0eeed40f27bbe14c38efab043574739dcd7ebad12"} Jul 12 19:20:26.266845 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:26.266785 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qz8dx" podStartSLOduration=5.497730992 podStartE2EDuration="25.266764139s" totalImagesPullingTime="19.769033147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:20:26.266483082 +0000 UTC m=+25.800471284" watchObservedRunningTime="2026-07-12 19:20:26.266764139 +0000 UTC m=+25.800752319" Jul 12 19:20:27.005908 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:27.005879 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:27.006098 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:27.005876 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:27.006098 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:27.006020 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:27.006177 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:27.006093 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:27.253325 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:27.253272 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" event={"ID":"bb5a4a9e-03a6-417a-84f5-511c5278484f","Type":"ContainerStarted","Data":"34de29213ea4726bf589ad1a9dc82e6c3e886323b440dd1b6ea7e82e762dd9c3"} Jul 12 19:20:27.255745 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:27.255710 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" event={"ID":"c09b5347-531e-4f49-b90f-f65832132591","Type":"ContainerStarted","Data":"eaf3fe6eb2cda62d5d526f2cab11bfd883fc6cd0a9eb388ce9b6f32dd9451659"} Jul 12 19:20:27.272748 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:27.272664 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvmcm" podStartSLOduration=4.161645457 podStartE2EDuration="26.272643674s" totalImagesPullingTime="22.110998217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:20:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:20:27.271911787 +0000 UTC m=+26.805899963" watchObservedRunningTime="2026-07-12 19:20:27.272643674 +0000 UTC m=+26.806631848" Jul 12 19:20:28.005839 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:28.005803 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:28.006018 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:28.005931 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:28.288339 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:28.288030 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rsf7p" Jul 12 19:20:28.288761 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:28.288683 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rsf7p" Jul 12 19:20:28.289411 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:28.289390 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rsf7p" Jul 12 19:20:28.289820 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:28.289801 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rsf7p" Jul 12 19:20:29.006070 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:29.005958 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:29.006276 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:29.006082 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:29.006276 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:29.006137 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:29.006529 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:29.006264 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:29.260659 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:29.260570 2572 generic.go:356] "Generic (PLEG): container finished" podID="b8808a46-de8e-4f1d-b36a-eb8d99b160b3" containerID="0d4ed30d4f246966c7e5284623a06cdc0c05a68d4f2b0143ca60854d6956b85a" exitCode=0 Jul 12 19:20:29.260805 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:29.260668 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74nhl" event={"ID":"b8808a46-de8e-4f1d-b36a-eb8d99b160b3","Type":"ContainerDied","Data":"0d4ed30d4f246966c7e5284623a06cdc0c05a68d4f2b0143ca60854d6956b85a"} Jul 12 19:20:29.264537 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:29.264511 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" event={"ID":"bb5a4a9e-03a6-417a-84f5-511c5278484f","Type":"ContainerStarted","Data":"c1b6023dcee4d8dea07552abbd82c26fd409a0ca50fa7f7809d0e149dcaa5c8f"} Jul 12 19:20:29.304023 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:29.303980 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" podStartSLOduration=8.444821099 podStartE2EDuration="28.303966768s" totalImagesPullingTime="19.859145669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:20:29.30314023 +0000 UTC m=+28.837128405" watchObservedRunningTime="2026-07-12 19:20:29.303966768 +0000 UTC m=+28.837954942" Jul 12 19:20:30.005825 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:30.005648 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:30.006015 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:30.005928 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:30.267234 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:30.267131 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:30.267234 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:30.267216 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:30.267429 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:30.267267 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:30.282156 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:30.282128 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:30.282942 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:30.282924 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:20:30.884400 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:30.884359 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5pzz7"] Jul 12 19:20:30.884829 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:30.884502 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:30.884829 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:30.884583 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:30.887358 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:30.887331 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6z2hb"] Jul 12 19:20:30.887521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:30.887443 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:30.887582 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:30.887537 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:30.887838 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:30.887821 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5t7x2"] Jul 12 19:20:30.887921 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:30.887908 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:30.888031 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:30.888011 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:31.271156 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:31.271078 2572 generic.go:356] "Generic (PLEG): container finished" podID="b8808a46-de8e-4f1d-b36a-eb8d99b160b3" containerID="197f5e506c8e2b06f3c429023fce728106b1b98400a97188184ba8b237b268c2" exitCode=0 Jul 12 19:20:31.271394 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:31.271167 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74nhl" event={"ID":"b8808a46-de8e-4f1d-b36a-eb8d99b160b3","Type":"ContainerDied","Data":"197f5e506c8e2b06f3c429023fce728106b1b98400a97188184ba8b237b268c2"} Jul 12 19:20:33.009441 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:33.009414 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:33.009827 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:33.009509 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:33.009827 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:33.009513 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:33.009827 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:33.009536 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:33.009827 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:33.009611 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:33.009827 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:33.009678 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:33.278634 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:33.278539 2572 generic.go:356] "Generic (PLEG): container finished" podID="b8808a46-de8e-4f1d-b36a-eb8d99b160b3" containerID="a4c738662308b1056ee3906a589efe5f1c2e85b15dda63a5aaac6a55620ba86e" exitCode=0 Jul 12 19:20:33.278634 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:33.278588 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74nhl" event={"ID":"b8808a46-de8e-4f1d-b36a-eb8d99b160b3","Type":"ContainerDied","Data":"a4c738662308b1056ee3906a589efe5f1c2e85b15dda63a5aaac6a55620ba86e"} Jul 12 19:20:34.635822 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:34.635569 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:34.636215 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:34.635719 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:20:34.636215 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:34.635977 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs podName:9b658735-f326-4144-a145-c33b84cff253 nodeName:}" failed. No retries permitted until 2026-07-12 19:21:06.635952176 +0000 UTC m=+66.169940332 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs") pod "network-metrics-daemon-5t7x2" (UID: "9b658735-f326-4144-a145-c33b84cff253") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:20:34.737182 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:34.737146 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5w74\" (UniqueName: \"kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74\") pod \"network-check-target-6z2hb\" (UID: \"b3f58533-1ffa-468f-9f35-e16b38d920fb\") " pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:34.737369 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:34.737190 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:34.737369 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:34.737320 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 19:20:34.737369 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:34.737346 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 19:20:34.737369 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:34.737371 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 19:20:34.737565 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:34.737381 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret podName:2c56f312-5f0b-47d4-a4be-1a366e433488 nodeName:}" failed. No retries permitted until 2026-07-12 19:21:06.737363897 +0000 UTC m=+66.271352053 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret") pod "global-pull-secret-syncer-5pzz7" (UID: "2c56f312-5f0b-47d4-a4be-1a366e433488") : object "kube-system"/"original-pull-secret" not registered Jul 12 19:20:34.737565 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:34.737384 2572 projected.go:196] Error preparing data for projected volume kube-api-access-g5w74 for pod openshift-network-diagnostics/network-check-target-6z2hb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:20:34.737565 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:34.737436 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74 podName:b3f58533-1ffa-468f-9f35-e16b38d920fb nodeName:}" failed. No retries permitted until 2026-07-12 19:21:06.737419281 +0000 UTC m=+66.271407439 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5w74" (UniqueName: "kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74") pod "network-check-target-6z2hb" (UID: "b3f58533-1ffa-468f-9f35-e16b38d920fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:20:35.009452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:35.009425 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:35.009611 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:35.009534 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pzz7" podUID="2c56f312-5f0b-47d4-a4be-1a366e433488" Jul 12 19:20:35.009830 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:35.009812 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:35.009924 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:35.009887 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2hb" podUID="b3f58533-1ffa-468f-9f35-e16b38d920fb" Jul 12 19:20:35.009924 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:35.009920 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:35.009997 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:35.009973 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:20:36.780171 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.780094 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeReady" Jul 12 19:20:36.780608 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.780240 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 12 19:20:36.827319 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.827275 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kcrwk"] Jul 12 19:20:36.858224 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.858191 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zmnpn"] Jul 12 19:20:36.858402 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.858354 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:36.861068 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.861043 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qvb27\"" Jul 12 19:20:36.861196 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.861085 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 12 19:20:36.861718 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.861319 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 12 19:20:36.872325 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.872302 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zmnpn"] Jul 12 19:20:36.872429 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.872337 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kcrwk"] Jul 12 19:20:36.872429 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.872378 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zmnpn" Jul 12 19:20:36.875158 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.875139 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 12 19:20:36.875376 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.875360 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 12 19:20:36.875466 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.875414 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 12 19:20:36.875522 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.875467 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g7h2t\"" Jul 12 19:20:36.955584 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.955553 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb6c2\" (UniqueName: \"kubernetes.io/projected/37a6f7e0-6c8e-47db-b215-c38182a2a58d-kube-api-access-qb6c2\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:36.955584 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.955601 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37a6f7e0-6c8e-47db-b215-c38182a2a58d-config-volume\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:36.955819 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.955704 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:36.955819 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:36.955744 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37a6f7e0-6c8e-47db-b215-c38182a2a58d-tmp-dir\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:37.005813 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.005781 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:20:37.005971 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.005781 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:20:37.006021 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.005781 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:20:37.008870 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.008829 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 12 19:20:37.008870 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.008841 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 12 19:20:37.008870 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.008871 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 12 19:20:37.009119 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.008956 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 12 19:20:37.009119 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.008829 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-brd5c\"" Jul 12 19:20:37.009220 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.009206 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zkgdj\"" Jul 12 19:20:37.056529 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.056449 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37a6f7e0-6c8e-47db-b215-c38182a2a58d-config-volume\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:37.056529 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.056522 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65dmc\" (UniqueName: \"kubernetes.io/projected/f6c11714-ec96-445c-8eff-3b3c33906653-kube-api-access-65dmc\") pod \"ingress-canary-zmnpn\" (UID: \"f6c11714-ec96-445c-8eff-3b3c33906653\") " pod="openshift-ingress-canary/ingress-canary-zmnpn" Jul 12 19:20:37.056741 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.056550 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:37.056741 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.056577 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37a6f7e0-6c8e-47db-b215-c38182a2a58d-tmp-dir\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:37.056741 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.056691 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6c11714-ec96-445c-8eff-3b3c33906653-cert\") pod \"ingress-canary-zmnpn\" (UID: \"f6c11714-ec96-445c-8eff-3b3c33906653\") " pod="openshift-ingress-canary/ingress-canary-zmnpn" Jul 12 19:20:37.056741 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:37.056710 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 19:20:37.056940 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:37.056772 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls podName:37a6f7e0-6c8e-47db-b215-c38182a2a58d nodeName:}" failed. No retries permitted until 2026-07-12 19:20:37.556755242 +0000 UTC m=+37.090743395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls") pod "dns-default-kcrwk" (UID: "37a6f7e0-6c8e-47db-b215-c38182a2a58d") : secret "dns-default-metrics-tls" not found Jul 12 19:20:37.056940 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.056794 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb6c2\" (UniqueName: \"kubernetes.io/projected/37a6f7e0-6c8e-47db-b215-c38182a2a58d-kube-api-access-qb6c2\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:37.056940 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.056935 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37a6f7e0-6c8e-47db-b215-c38182a2a58d-tmp-dir\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:37.057167 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.057143 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37a6f7e0-6c8e-47db-b215-c38182a2a58d-config-volume\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:37.069408 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.069388 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb6c2\" (UniqueName: \"kubernetes.io/projected/37a6f7e0-6c8e-47db-b215-c38182a2a58d-kube-api-access-qb6c2\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:37.157497 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.157458 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65dmc\" (UniqueName: \"kubernetes.io/projected/f6c11714-ec96-445c-8eff-3b3c33906653-kube-api-access-65dmc\") pod \"ingress-canary-zmnpn\" (UID: \"f6c11714-ec96-445c-8eff-3b3c33906653\") " pod="openshift-ingress-canary/ingress-canary-zmnpn" Jul 12 19:20:37.157667 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.157536 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6c11714-ec96-445c-8eff-3b3c33906653-cert\") pod \"ingress-canary-zmnpn\" (UID: \"f6c11714-ec96-445c-8eff-3b3c33906653\") " pod="openshift-ingress-canary/ingress-canary-zmnpn" Jul 12 19:20:37.161415 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.161384 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6c11714-ec96-445c-8eff-3b3c33906653-cert\") pod \"ingress-canary-zmnpn\" (UID: \"f6c11714-ec96-445c-8eff-3b3c33906653\") " pod="openshift-ingress-canary/ingress-canary-zmnpn" Jul 12 19:20:37.166686 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.166662 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65dmc\" (UniqueName: \"kubernetes.io/projected/f6c11714-ec96-445c-8eff-3b3c33906653-kube-api-access-65dmc\") pod \"ingress-canary-zmnpn\" (UID: \"f6c11714-ec96-445c-8eff-3b3c33906653\") " pod="openshift-ingress-canary/ingress-canary-zmnpn" Jul 12 19:20:37.182743 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.182713 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zmnpn" Jul 12 19:20:37.434441 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.434414 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zmnpn"] Jul 12 19:20:37.460079 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:20:37.460051 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6c11714_ec96_445c_8eff_3b3c33906653.slice/crio-4e9bfc1d57d03f48d16668e219c0ade41ea84c2b763f720f3cae019c26d2c318 WatchSource:0}: Error finding container 4e9bfc1d57d03f48d16668e219c0ade41ea84c2b763f720f3cae019c26d2c318: Status 404 returned error can't find the container with id 4e9bfc1d57d03f48d16668e219c0ade41ea84c2b763f720f3cae019c26d2c318 Jul 12 19:20:37.560145 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:37.560003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:37.560228 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:37.560144 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 19:20:37.560228 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:37.560202 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls podName:37a6f7e0-6c8e-47db-b215-c38182a2a58d nodeName:}" failed. No retries permitted until 2026-07-12 19:20:38.560187633 +0000 UTC m=+38.094175786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls") pod "dns-default-kcrwk" (UID: "37a6f7e0-6c8e-47db-b215-c38182a2a58d") : secret "dns-default-metrics-tls" not found Jul 12 19:20:38.291121 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:38.291079 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zmnpn" event={"ID":"f6c11714-ec96-445c-8eff-3b3c33906653","Type":"ContainerStarted","Data":"4e9bfc1d57d03f48d16668e219c0ade41ea84c2b763f720f3cae019c26d2c318"} Jul 12 19:20:38.294492 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:38.294464 2572 generic.go:356] "Generic (PLEG): container finished" podID="b8808a46-de8e-4f1d-b36a-eb8d99b160b3" containerID="e17a5cea7255f711a8e12eff0d0bb7355a7816715f7972704e86204ba6ef09cd" exitCode=0 Jul 12 19:20:38.294637 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:38.294509 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74nhl" event={"ID":"b8808a46-de8e-4f1d-b36a-eb8d99b160b3","Type":"ContainerDied","Data":"e17a5cea7255f711a8e12eff0d0bb7355a7816715f7972704e86204ba6ef09cd"} Jul 12 19:20:38.567170 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:38.567084 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:38.567344 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:38.567234 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 19:20:38.567344 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:38.567329 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls podName:37a6f7e0-6c8e-47db-b215-c38182a2a58d nodeName:}" failed. No retries permitted until 2026-07-12 19:20:40.567302539 +0000 UTC m=+40.101290693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls") pod "dns-default-kcrwk" (UID: "37a6f7e0-6c8e-47db-b215-c38182a2a58d") : secret "dns-default-metrics-tls" not found Jul 12 19:20:39.300756 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:39.300715 2572 generic.go:356] "Generic (PLEG): container finished" podID="b8808a46-de8e-4f1d-b36a-eb8d99b160b3" containerID="03a87954341102ce913d24da40ce212b419cb38d4888f557242029999faaeb7d" exitCode=0 Jul 12 19:20:39.301193 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:39.300794 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74nhl" event={"ID":"b8808a46-de8e-4f1d-b36a-eb8d99b160b3","Type":"ContainerDied","Data":"03a87954341102ce913d24da40ce212b419cb38d4888f557242029999faaeb7d"} Jul 12 19:20:40.304411 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:40.304374 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zmnpn" event={"ID":"f6c11714-ec96-445c-8eff-3b3c33906653","Type":"ContainerStarted","Data":"5b61de4a87aabe01cfb93f9f004cbcf7b17925227e434905e42090aad1e3c95f"} Jul 12 19:20:40.307440 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:40.307411 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74nhl" event={"ID":"b8808a46-de8e-4f1d-b36a-eb8d99b160b3","Type":"ContainerStarted","Data":"fe88f0a4e87d3a110431f536d7b67b8f4632a67133871659552b9ee5cbc712b4"} Jul 12 19:20:40.319250 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:40.319213 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zmnpn" podStartSLOduration=2.046160314 podStartE2EDuration="4.319200652s" totalImagesPullingTime="2.273040338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:20:40.318985706 +0000 UTC m=+39.852973880" watchObservedRunningTime="2026-07-12 19:20:40.319200652 +0000 UTC m=+39.853188826" Jul 12 19:20:40.341390 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:40.341340 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-74nhl" podStartSLOduration=8.487608551 podStartE2EDuration="39.34132212s" totalImagesPullingTime="30.853713569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:20:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:20:40.340228598 +0000 UTC m=+39.874216772" watchObservedRunningTime="2026-07-12 19:20:40.34132212 +0000 UTC m=+39.875310298" Jul 12 19:20:40.583008 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:40.582912 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:40.583163 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:40.583061 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 19:20:40.583163 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:40.583124 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls podName:37a6f7e0-6c8e-47db-b215-c38182a2a58d nodeName:}" failed. No retries permitted until 2026-07-12 19:20:44.583108835 +0000 UTC m=+44.117096992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls") pod "dns-default-kcrwk" (UID: "37a6f7e0-6c8e-47db-b215-c38182a2a58d") : secret "dns-default-metrics-tls" not found Jul 12 19:20:44.613094 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:44.613056 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:44.613491 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:44.613170 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 19:20:44.613491 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:44.613224 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls podName:37a6f7e0-6c8e-47db-b215-c38182a2a58d nodeName:}" failed. No retries permitted until 2026-07-12 19:20:52.613210226 +0000 UTC m=+52.147198379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls") pod "dns-default-kcrwk" (UID: "37a6f7e0-6c8e-47db-b215-c38182a2a58d") : secret "dns-default-metrics-tls" not found Jul 12 19:20:52.665727 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:20:52.665678 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:20:52.666178 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:52.665843 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 19:20:52.666178 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:20:52.665919 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls podName:37a6f7e0-6c8e-47db-b215-c38182a2a58d nodeName:}" failed. No retries permitted until 2026-07-12 19:21:08.665902922 +0000 UTC m=+68.199891082 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls") pod "dns-default-kcrwk" (UID: "37a6f7e0-6c8e-47db-b215-c38182a2a58d") : secret "dns-default-metrics-tls" not found Jul 12 19:21:02.301595 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:02.301562 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9s2cn" Jul 12 19:21:06.664018 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:06.663980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:21:06.666731 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:06.666714 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 12 19:21:06.674726 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:21:06.674705 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 12 19:21:06.674782 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:21:06.674774 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs podName:9b658735-f326-4144-a145-c33b84cff253 nodeName:}" failed. No retries permitted until 2026-07-12 19:22:10.674759341 +0000 UTC m=+130.208747494 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs") pod "network-metrics-daemon-5t7x2" (UID: "9b658735-f326-4144-a145-c33b84cff253") : secret "metrics-daemon-secret" not found Jul 12 19:21:06.764899 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:06.764862 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5w74\" (UniqueName: \"kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74\") pod \"network-check-target-6z2hb\" (UID: \"b3f58533-1ffa-468f-9f35-e16b38d920fb\") " pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:21:06.765004 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:06.764905 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:21:06.767765 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:06.767748 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 12 19:21:06.767866 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:06.767764 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 12 19:21:06.778077 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:06.778052 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 12 19:21:06.779720 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:06.779701 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c56f312-5f0b-47d4-a4be-1a366e433488-original-pull-secret\") pod \"global-pull-secret-syncer-5pzz7\" (UID: \"2c56f312-5f0b-47d4-a4be-1a366e433488\") " pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:21:06.788245 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:06.788217 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5w74\" (UniqueName: \"kubernetes.io/projected/b3f58533-1ffa-468f-9f35-e16b38d920fb-kube-api-access-g5w74\") pod \"network-check-target-6z2hb\" (UID: \"b3f58533-1ffa-468f-9f35-e16b38d920fb\") " pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:21:07.016813 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:07.016732 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pzz7" Jul 12 19:21:07.026540 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:07.026516 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zkgdj\"" Jul 12 19:21:07.034612 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:07.034584 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:21:07.166699 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:07.166668 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5pzz7"] Jul 12 19:21:07.170732 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:21:07.170705 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c56f312_5f0b_47d4_a4be_1a366e433488.slice/crio-92dc7de3f12370901880bdbc70125aa53886fd348108606333ded0b7526b6df3 WatchSource:0}: Error finding container 92dc7de3f12370901880bdbc70125aa53886fd348108606333ded0b7526b6df3: Status 404 returned error can't find the container with id 92dc7de3f12370901880bdbc70125aa53886fd348108606333ded0b7526b6df3 Jul 12 19:21:07.176981 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:07.176961 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6z2hb"] Jul 12 19:21:07.179924 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:21:07.179904 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f58533_1ffa_468f_9f35_e16b38d920fb.slice/crio-e90143df7f9e49f81b3cec147089816ae8fcec7b2549c425ed2fdf6eb4cce20a WatchSource:0}: Error finding container e90143df7f9e49f81b3cec147089816ae8fcec7b2549c425ed2fdf6eb4cce20a: Status 404 returned error can't find the container with id e90143df7f9e49f81b3cec147089816ae8fcec7b2549c425ed2fdf6eb4cce20a Jul 12 19:21:07.372886 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:07.372851 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6z2hb" event={"ID":"b3f58533-1ffa-468f-9f35-e16b38d920fb","Type":"ContainerStarted","Data":"e90143df7f9e49f81b3cec147089816ae8fcec7b2549c425ed2fdf6eb4cce20a"} Jul 12 19:21:07.373811 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:07.373789 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5pzz7" event={"ID":"2c56f312-5f0b-47d4-a4be-1a366e433488","Type":"ContainerStarted","Data":"92dc7de3f12370901880bdbc70125aa53886fd348108606333ded0b7526b6df3"} Jul 12 19:21:08.680785 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:08.680733 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:21:08.681174 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:21:08.680868 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 19:21:08.681174 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:21:08.680946 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls podName:37a6f7e0-6c8e-47db-b215-c38182a2a58d nodeName:}" failed. No retries permitted until 2026-07-12 19:21:40.680922511 +0000 UTC m=+100.214910711 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls") pod "dns-default-kcrwk" (UID: "37a6f7e0-6c8e-47db-b215-c38182a2a58d") : secret "dns-default-metrics-tls" not found Jul 12 19:21:12.389692 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:12.389651 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6z2hb" event={"ID":"b3f58533-1ffa-468f-9f35-e16b38d920fb","Type":"ContainerStarted","Data":"68089d9e194ec74b6abfcb3fa9cb19af890a58ae0e19ec14facc09fb53a9b4f7"} Jul 12 19:21:12.390143 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:12.389740 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:21:12.391111 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:12.391090 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5pzz7" event={"ID":"2c56f312-5f0b-47d4-a4be-1a366e433488","Type":"ContainerStarted","Data":"d63e85016e009fcbd13db791089235f1b35e80ac6b88bcd9238a10759d9dec8b"} Jul 12 19:21:12.404424 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:12.404385 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6z2hb" podStartSLOduration=66.734564859 podStartE2EDuration="1m11.404373728s" totalImagesPullingTime="4.669808869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:21:12.403912459 +0000 UTC m=+71.937900633" watchObservedRunningTime="2026-07-12 19:21:12.404373728 +0000 UTC m=+71.938361881" Jul 12 19:21:12.416794 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:12.416750 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5pzz7" podStartSLOduration=65.724277672 podStartE2EDuration="1m10.416739827s" totalImagesPullingTime="4.692462155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:21:12.416693044 +0000 UTC m=+71.950681231" watchObservedRunningTime="2026-07-12 19:21:12.416739827 +0000 UTC m=+71.950727997" Jul 12 19:21:40.687571 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:40.687516 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:21:40.688001 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:21:40.687646 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 19:21:40.688001 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:21:40.687708 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls podName:37a6f7e0-6c8e-47db-b215-c38182a2a58d nodeName:}" failed. No retries permitted until 2026-07-12 19:22:44.687690117 +0000 UTC m=+164.221678270 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls") pod "dns-default-kcrwk" (UID: "37a6f7e0-6c8e-47db-b215-c38182a2a58d") : secret "dns-default-metrics-tls" not found Jul 12 19:21:43.396046 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:21:43.396017 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6z2hb" Jul 12 19:22:10.689570 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:22:10.689515 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:22:10.689992 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:22:10.689698 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 12 19:22:10.689992 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:22:10.689789 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs podName:9b658735-f326-4144-a145-c33b84cff253 nodeName:}" failed. No retries permitted until 2026-07-12 19:24:12.689770331 +0000 UTC m=+252.223758488 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs") pod "network-metrics-daemon-5t7x2" (UID: "9b658735-f326-4144-a145-c33b84cff253") : secret "metrics-daemon-secret" not found Jul 12 19:22:39.868440 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:22:39.868388 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kcrwk" podUID="37a6f7e0-6c8e-47db-b215-c38182a2a58d" Jul 12 19:22:40.028492 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:22:40.028451 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:22:40.595211 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:22:40.595182 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kcrwk" Jul 12 19:22:44.720662 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:22:44.720610 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:22:44.721075 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:22:44.720770 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 19:22:44.721075 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:22:44.720844 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls podName:37a6f7e0-6c8e-47db-b215-c38182a2a58d nodeName:}" failed. No retries permitted until 2026-07-12 19:24:46.720828152 +0000 UTC m=+286.254816305 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls") pod "dns-default-kcrwk" (UID: "37a6f7e0-6c8e-47db-b215-c38182a2a58d") : secret "dns-default-metrics-tls" not found Jul 12 19:22:54.005612 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:22:54.005527 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:24:07.746781 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.746731 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb"] Jul 12 19:24:07.748484 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.748467 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-5gqk8"] Jul 12 19:24:07.748603 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.748586 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" Jul 12 19:24:07.750340 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.750322 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.751055 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.751038 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 12 19:24:07.751156 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.751070 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 12 19:24:07.751156 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.751123 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 12 19:24:07.751266 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.751203 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 12 19:24:07.751444 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.751428 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ldbpw\"" Jul 12 19:24:07.752737 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.752721 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 12 19:24:07.752832 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.752719 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 12 19:24:07.752832 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.752822 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gz8jz\"" Jul 12 19:24:07.752945 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.752841 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 12 19:24:07.753504 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.753487 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 12 19:24:07.761625 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.761474 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 12 19:24:07.762655 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.762632 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb"] Jul 12 19:24:07.763356 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.763331 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-5gqk8"] Jul 12 19:24:07.841854 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.841817 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk"] Jul 12 19:24:07.843962 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.843945 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz"] Jul 12 19:24:07.844089 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.844074 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:07.845876 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.845859 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9"] Jul 12 19:24:07.845975 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.845961 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" Jul 12 19:24:07.846452 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.846433 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 12 19:24:07.846556 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.846469 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 12 19:24:07.846612 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.846594 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4sfnf\"" Jul 12 19:24:07.847807 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.847793 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" Jul 12 19:24:07.848038 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.848017 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 12 19:24:07.848384 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.848363 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 12 19:24:07.848476 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.848398 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 12 19:24:07.848476 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.848437 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 12 19:24:07.848476 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.848458 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-c2ms5\"" Jul 12 19:24:07.848855 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.848841 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 12 19:24:07.849197 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.849184 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 12 19:24:07.850731 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.850712 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 12 19:24:07.850997 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.850976 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 12 19:24:07.852010 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.851991 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ll9jr\"" Jul 12 19:24:07.852218 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.852201 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 12 19:24:07.855034 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.854907 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8524be03-4385-4b02-a94c-3828707d13d5-tmp\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.855034 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.854940 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8524be03-4385-4b02-a94c-3828707d13d5-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.855034 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.854972 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8524be03-4385-4b02-a94c-3828707d13d5-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.855230 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.855059 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb491ad0-27ae-489b-855e-dad3e389278e-config\") pod \"service-ca-operator-7695fc6c8c-htbxb\" (UID: \"bb491ad0-27ae-489b-855e-dad3e389278e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" Jul 12 19:24:07.855230 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.855112 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb491ad0-27ae-489b-855e-dad3e389278e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-htbxb\" (UID: \"bb491ad0-27ae-489b-855e-dad3e389278e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" Jul 12 19:24:07.855230 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.855168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxlfk\" (UniqueName: \"kubernetes.io/projected/bb491ad0-27ae-489b-855e-dad3e389278e-kube-api-access-xxlfk\") pod \"service-ca-operator-7695fc6c8c-htbxb\" (UID: \"bb491ad0-27ae-489b-855e-dad3e389278e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" Jul 12 19:24:07.855230 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.855212 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8524be03-4385-4b02-a94c-3828707d13d5-snapshots\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.855488 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.855238 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8524be03-4385-4b02-a94c-3828707d13d5-serving-cert\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.855488 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.855303 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmt8j\" (UniqueName: \"kubernetes.io/projected/8524be03-4385-4b02-a94c-3828707d13d5-kube-api-access-kmt8j\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.856519 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.856494 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9"] Jul 12 19:24:07.857576 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.857551 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk"] Jul 12 19:24:07.858397 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.858379 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz"] Jul 12 19:24:07.956456 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956416 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-t92kk\" (UID: \"30f415e8-a1ee-40c8-972b-c88fe2d30530\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:07.956456 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956457 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmt8j\" (UniqueName: \"kubernetes.io/projected/8524be03-4385-4b02-a94c-3828707d13d5-kube-api-access-kmt8j\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.956670 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956486 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lp4m9\" (UID: \"58523a33-411c-4650-b42c-d2f543a29841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" Jul 12 19:24:07.956670 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956535 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8524be03-4385-4b02-a94c-3828707d13d5-tmp\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.956670 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956552 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8524be03-4385-4b02-a94c-3828707d13d5-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.956796 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956665 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/30f415e8-a1ee-40c8-972b-c88fe2d30530-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-t92kk\" (UID: \"30f415e8-a1ee-40c8-972b-c88fe2d30530\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:07.956796 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956704 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8524be03-4385-4b02-a94c-3828707d13d5-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.956796 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956723 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db7d2e1a-d427-41f6-8273-a1d24a6910ab-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-zjwlz\" (UID: \"db7d2e1a-d427-41f6-8273-a1d24a6910ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" Jul 12 19:24:07.956796 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956759 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db7d2e1a-d427-41f6-8273-a1d24a6910ab-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-zjwlz\" (UID: \"db7d2e1a-d427-41f6-8273-a1d24a6910ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" Jul 12 19:24:07.956796 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956780 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp7r6\" (UniqueName: \"kubernetes.io/projected/db7d2e1a-d427-41f6-8273-a1d24a6910ab-kube-api-access-gp7r6\") pod \"kube-storage-version-migrator-operator-799cb7f958-zjwlz\" (UID: \"db7d2e1a-d427-41f6-8273-a1d24a6910ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" Jul 12 19:24:07.957044 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb491ad0-27ae-489b-855e-dad3e389278e-config\") pod \"service-ca-operator-7695fc6c8c-htbxb\" (UID: \"bb491ad0-27ae-489b-855e-dad3e389278e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" Jul 12 19:24:07.957044 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956829 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kdlw\" (UniqueName: \"kubernetes.io/projected/30f415e8-a1ee-40c8-972b-c88fe2d30530-kube-api-access-9kdlw\") pod \"cluster-monitoring-operator-5f7f494dd4-t92kk\" (UID: \"30f415e8-a1ee-40c8-972b-c88fe2d30530\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:07.957044 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956855 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mczr9\" (UniqueName: \"kubernetes.io/projected/58523a33-411c-4650-b42c-d2f543a29841-kube-api-access-mczr9\") pod \"cluster-samples-operator-65db858894-lp4m9\" (UID: \"58523a33-411c-4650-b42c-d2f543a29841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" Jul 12 19:24:07.957044 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956976 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb491ad0-27ae-489b-855e-dad3e389278e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-htbxb\" (UID: \"bb491ad0-27ae-489b-855e-dad3e389278e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" Jul 12 19:24:07.957044 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956980 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8524be03-4385-4b02-a94c-3828707d13d5-tmp\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.957044 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.956997 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxlfk\" (UniqueName: \"kubernetes.io/projected/bb491ad0-27ae-489b-855e-dad3e389278e-kube-api-access-xxlfk\") pod \"service-ca-operator-7695fc6c8c-htbxb\" (UID: \"bb491ad0-27ae-489b-855e-dad3e389278e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" Jul 12 19:24:07.957044 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.957035 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8524be03-4385-4b02-a94c-3828707d13d5-snapshots\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.957417 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.957059 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8524be03-4385-4b02-a94c-3828707d13d5-serving-cert\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.957417 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.957164 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8524be03-4385-4b02-a94c-3828707d13d5-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.957520 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.957473 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb491ad0-27ae-489b-855e-dad3e389278e-config\") pod \"service-ca-operator-7695fc6c8c-htbxb\" (UID: \"bb491ad0-27ae-489b-855e-dad3e389278e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" Jul 12 19:24:07.957646 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.957630 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8524be03-4385-4b02-a94c-3828707d13d5-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.957687 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.957645 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8524be03-4385-4b02-a94c-3828707d13d5-snapshots\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.959450 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.959427 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb491ad0-27ae-489b-855e-dad3e389278e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-htbxb\" (UID: \"bb491ad0-27ae-489b-855e-dad3e389278e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" Jul 12 19:24:07.959552 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.959486 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8524be03-4385-4b02-a94c-3828707d13d5-serving-cert\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:07.964781 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.964762 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxlfk\" (UniqueName: \"kubernetes.io/projected/bb491ad0-27ae-489b-855e-dad3e389278e-kube-api-access-xxlfk\") pod \"service-ca-operator-7695fc6c8c-htbxb\" (UID: \"bb491ad0-27ae-489b-855e-dad3e389278e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" Jul 12 19:24:07.965132 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:07.965113 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmt8j\" (UniqueName: \"kubernetes.io/projected/8524be03-4385-4b02-a94c-3828707d13d5-kube-api-access-kmt8j\") pod \"insights-operator-68d9dd94cf-5gqk8\" (UID: \"8524be03-4385-4b02-a94c-3828707d13d5\") " pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:08.057868 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.057768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/30f415e8-a1ee-40c8-972b-c88fe2d30530-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-t92kk\" (UID: \"30f415e8-a1ee-40c8-972b-c88fe2d30530\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:08.057868 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.057820 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db7d2e1a-d427-41f6-8273-a1d24a6910ab-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-zjwlz\" (UID: \"db7d2e1a-d427-41f6-8273-a1d24a6910ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" Jul 12 19:24:08.058054 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.057940 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db7d2e1a-d427-41f6-8273-a1d24a6910ab-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-zjwlz\" (UID: \"db7d2e1a-d427-41f6-8273-a1d24a6910ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" Jul 12 19:24:08.058054 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.057969 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp7r6\" (UniqueName: \"kubernetes.io/projected/db7d2e1a-d427-41f6-8273-a1d24a6910ab-kube-api-access-gp7r6\") pod \"kube-storage-version-migrator-operator-799cb7f958-zjwlz\" (UID: \"db7d2e1a-d427-41f6-8273-a1d24a6910ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" Jul 12 19:24:08.058054 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.058011 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kdlw\" (UniqueName: \"kubernetes.io/projected/30f415e8-a1ee-40c8-972b-c88fe2d30530-kube-api-access-9kdlw\") pod \"cluster-monitoring-operator-5f7f494dd4-t92kk\" (UID: \"30f415e8-a1ee-40c8-972b-c88fe2d30530\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:08.058054 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.058029 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mczr9\" (UniqueName: \"kubernetes.io/projected/58523a33-411c-4650-b42c-d2f543a29841-kube-api-access-mczr9\") pod \"cluster-samples-operator-65db858894-lp4m9\" (UID: \"58523a33-411c-4650-b42c-d2f543a29841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" Jul 12 19:24:08.058252 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.058088 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-t92kk\" (UID: \"30f415e8-a1ee-40c8-972b-c88fe2d30530\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:08.058252 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.058118 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lp4m9\" (UID: \"58523a33-411c-4650-b42c-d2f543a29841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" Jul 12 19:24:08.058252 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:08.058227 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 19:24:08.058434 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:08.058251 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 19:24:08.058434 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:08.058335 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls podName:58523a33-411c-4650-b42c-d2f543a29841 nodeName:}" failed. No retries permitted until 2026-07-12 19:24:08.558318186 +0000 UTC m=+248.092306342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls") pod "cluster-samples-operator-65db858894-lp4m9" (UID: "58523a33-411c-4650-b42c-d2f543a29841") : secret "samples-operator-tls" not found Jul 12 19:24:08.058434 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:08.058349 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls podName:30f415e8-a1ee-40c8-972b-c88fe2d30530 nodeName:}" failed. No retries permitted until 2026-07-12 19:24:08.558343167 +0000 UTC m=+248.092331320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-t92kk" (UID: "30f415e8-a1ee-40c8-972b-c88fe2d30530") : secret "cluster-monitoring-operator-tls" not found Jul 12 19:24:08.058638 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.058616 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db7d2e1a-d427-41f6-8273-a1d24a6910ab-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-zjwlz\" (UID: \"db7d2e1a-d427-41f6-8273-a1d24a6910ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" Jul 12 19:24:08.058787 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.058694 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/30f415e8-a1ee-40c8-972b-c88fe2d30530-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-t92kk\" (UID: \"30f415e8-a1ee-40c8-972b-c88fe2d30530\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:08.058935 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.058920 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" Jul 12 19:24:08.060426 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.060406 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db7d2e1a-d427-41f6-8273-a1d24a6910ab-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-zjwlz\" (UID: \"db7d2e1a-d427-41f6-8273-a1d24a6910ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" Jul 12 19:24:08.066389 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.066366 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" Jul 12 19:24:08.067131 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.067108 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mczr9\" (UniqueName: \"kubernetes.io/projected/58523a33-411c-4650-b42c-d2f543a29841-kube-api-access-mczr9\") pod \"cluster-samples-operator-65db858894-lp4m9\" (UID: \"58523a33-411c-4650-b42c-d2f543a29841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" Jul 12 19:24:08.067482 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.067462 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp7r6\" (UniqueName: \"kubernetes.io/projected/db7d2e1a-d427-41f6-8273-a1d24a6910ab-kube-api-access-gp7r6\") pod \"kube-storage-version-migrator-operator-799cb7f958-zjwlz\" (UID: \"db7d2e1a-d427-41f6-8273-a1d24a6910ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" Jul 12 19:24:08.067646 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.067630 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kdlw\" (UniqueName: \"kubernetes.io/projected/30f415e8-a1ee-40c8-972b-c88fe2d30530-kube-api-access-9kdlw\") pod \"cluster-monitoring-operator-5f7f494dd4-t92kk\" (UID: \"30f415e8-a1ee-40c8-972b-c88fe2d30530\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:08.161786 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.161755 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" Jul 12 19:24:08.191580 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.191550 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb"] Jul 12 19:24:08.194635 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:24:08.194608 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb491ad0_27ae_489b_855e_dad3e389278e.slice/crio-7d867cbcc4a7807c781839add0c55f5b33cf4bed864c6eda8937244268ced938 WatchSource:0}: Error finding container 7d867cbcc4a7807c781839add0c55f5b33cf4bed864c6eda8937244268ced938: Status 404 returned error can't find the container with id 7d867cbcc4a7807c781839add0c55f5b33cf4bed864c6eda8937244268ced938 Jul 12 19:24:08.206999 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.206977 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-5gqk8"] Jul 12 19:24:08.209517 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:24:08.209490 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8524be03_4385_4b02_a94c_3828707d13d5.slice/crio-0669c35a6663f40e32d85c8cfff01fd486fb98910c8645be6e0cbe83b6f0af80 WatchSource:0}: Error finding container 0669c35a6663f40e32d85c8cfff01fd486fb98910c8645be6e0cbe83b6f0af80: Status 404 returned error can't find the container with id 0669c35a6663f40e32d85c8cfff01fd486fb98910c8645be6e0cbe83b6f0af80 Jul 12 19:24:08.287708 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.287670 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz"] Jul 12 19:24:08.292646 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:24:08.292623 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7d2e1a_d427_41f6_8273_a1d24a6910ab.slice/crio-d47b4d5dd806ad2a776432c805734765b6d32a8b7d35ce97f39914978156c16d WatchSource:0}: Error finding container d47b4d5dd806ad2a776432c805734765b6d32a8b7d35ce97f39914978156c16d: Status 404 returned error can't find the container with id d47b4d5dd806ad2a776432c805734765b6d32a8b7d35ce97f39914978156c16d Jul 12 19:24:08.561936 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.561895 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-t92kk\" (UID: \"30f415e8-a1ee-40c8-972b-c88fe2d30530\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:08.562112 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.561943 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lp4m9\" (UID: \"58523a33-411c-4650-b42c-d2f543a29841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" Jul 12 19:24:08.562112 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:08.562052 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 19:24:08.562112 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:08.562053 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 19:24:08.562327 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:08.562118 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls podName:58523a33-411c-4650-b42c-d2f543a29841 nodeName:}" failed. No retries permitted until 2026-07-12 19:24:09.562099639 +0000 UTC m=+249.096087792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls") pod "cluster-samples-operator-65db858894-lp4m9" (UID: "58523a33-411c-4650-b42c-d2f543a29841") : secret "samples-operator-tls" not found Jul 12 19:24:08.562327 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:08.562202 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls podName:30f415e8-a1ee-40c8-972b-c88fe2d30530 nodeName:}" failed. No retries permitted until 2026-07-12 19:24:09.562183177 +0000 UTC m=+249.096171331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-t92kk" (UID: "30f415e8-a1ee-40c8-972b-c88fe2d30530") : secret "cluster-monitoring-operator-tls" not found Jul 12 19:24:08.796376 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.796320 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" event={"ID":"8524be03-4385-4b02-a94c-3828707d13d5","Type":"ContainerStarted","Data":"0669c35a6663f40e32d85c8cfff01fd486fb98910c8645be6e0cbe83b6f0af80"} Jul 12 19:24:08.797603 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.797579 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" event={"ID":"db7d2e1a-d427-41f6-8273-a1d24a6910ab","Type":"ContainerStarted","Data":"d47b4d5dd806ad2a776432c805734765b6d32a8b7d35ce97f39914978156c16d"} Jul 12 19:24:08.798837 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:08.798812 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" event={"ID":"bb491ad0-27ae-489b-855e-dad3e389278e","Type":"ContainerStarted","Data":"7d867cbcc4a7807c781839add0c55f5b33cf4bed864c6eda8937244268ced938"} Jul 12 19:24:09.571084 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:09.571048 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-t92kk\" (UID: \"30f415e8-a1ee-40c8-972b-c88fe2d30530\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:09.571261 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:09.571097 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lp4m9\" (UID: \"58523a33-411c-4650-b42c-d2f543a29841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" Jul 12 19:24:09.571261 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:09.571209 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 19:24:09.571261 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:09.571220 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 19:24:09.571430 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:09.571269 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls podName:58523a33-411c-4650-b42c-d2f543a29841 nodeName:}" failed. No retries permitted until 2026-07-12 19:24:11.571250544 +0000 UTC m=+251.105238702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls") pod "cluster-samples-operator-65db858894-lp4m9" (UID: "58523a33-411c-4650-b42c-d2f543a29841") : secret "samples-operator-tls" not found Jul 12 19:24:09.571430 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:09.571305 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls podName:30f415e8-a1ee-40c8-972b-c88fe2d30530 nodeName:}" failed. No retries permitted until 2026-07-12 19:24:11.571279008 +0000 UTC m=+251.105267161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-t92kk" (UID: "30f415e8-a1ee-40c8-972b-c88fe2d30530") : secret "cluster-monitoring-operator-tls" not found Jul 12 19:24:11.588124 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:11.588074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-t92kk\" (UID: \"30f415e8-a1ee-40c8-972b-c88fe2d30530\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:11.588491 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:11.588132 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lp4m9\" (UID: \"58523a33-411c-4650-b42c-d2f543a29841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" Jul 12 19:24:11.588491 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:11.588247 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 19:24:11.588491 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:11.588307 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 19:24:11.588491 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:11.588345 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls podName:30f415e8-a1ee-40c8-972b-c88fe2d30530 nodeName:}" failed. No retries permitted until 2026-07-12 19:24:15.588324134 +0000 UTC m=+255.122312292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-t92kk" (UID: "30f415e8-a1ee-40c8-972b-c88fe2d30530") : secret "cluster-monitoring-operator-tls" not found Jul 12 19:24:11.588491 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:11.588366 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls podName:58523a33-411c-4650-b42c-d2f543a29841 nodeName:}" failed. No retries permitted until 2026-07-12 19:24:15.588355901 +0000 UTC m=+255.122344057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls") pod "cluster-samples-operator-65db858894-lp4m9" (UID: "58523a33-411c-4650-b42c-d2f543a29841") : secret "samples-operator-tls" not found Jul 12 19:24:11.809635 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:11.809598 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" event={"ID":"db7d2e1a-d427-41f6-8273-a1d24a6910ab","Type":"ContainerStarted","Data":"3cf5ba6061f7a6a8fc8ea65e5b10a72450a1b10dff418eccf3f7e0c446267a6b"} Jul 12 19:24:11.811136 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:11.811111 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" event={"ID":"bb491ad0-27ae-489b-855e-dad3e389278e","Type":"ContainerStarted","Data":"e60bf6a3db889eb56d8fc42cd5d28e39621a6f18c2e70e6936ad5c8f80ca6eb6"} Jul 12 19:24:11.812663 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:11.812640 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" event={"ID":"8524be03-4385-4b02-a94c-3828707d13d5","Type":"ContainerStarted","Data":"e97cb6c5a581694574945076e0b555b1aa82782f85b756d8e263bae71787f1d9"} Jul 12 19:24:11.826866 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:11.826816 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" podStartSLOduration=2.134218724 podStartE2EDuration="4.826798545s" totalImagesPullingTime="2.692579821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:24:11.825070206 +0000 UTC m=+251.359058383" watchObservedRunningTime="2026-07-12 19:24:11.826798545 +0000 UTC m=+251.360786718" Jul 12 19:24:11.841156 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:11.840774 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" podStartSLOduration=2.071874433 podStartE2EDuration="4.84075517s" totalImagesPullingTime="2.768880737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:24:11.839824774 +0000 UTC m=+251.373812947" watchObservedRunningTime="2026-07-12 19:24:11.84075517 +0000 UTC m=+251.374743345" Jul 12 19:24:11.857799 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:11.857752 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" podStartSLOduration=2.070415994 podStartE2EDuration="4.857733665s" totalImagesPullingTime="2.787317671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:24:11.85643506 +0000 UTC m=+251.390423238" watchObservedRunningTime="2026-07-12 19:24:11.857733665 +0000 UTC m=+251.391721842" Jul 12 19:24:12.277690 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.277650 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-98rvr"] Jul 12 19:24:12.281912 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.281889 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:12.284618 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.284600 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 12 19:24:12.284618 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.284610 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jgmpf\"" Jul 12 19:24:12.285629 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.285611 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 12 19:24:12.295141 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.295112 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-98rvr"] Jul 12 19:24:12.395788 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.395756 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e53560-8031-4b38-bcfa-25ad4665c8cd-data-volume\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:12.395788 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.395796 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:12.395978 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.395868 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72e53560-8031-4b38-bcfa-25ad4665c8cd-crio-socket\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:12.395978 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.395933 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks7nr\" (UniqueName: \"kubernetes.io/projected/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-api-access-ks7nr\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:12.395978 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.395954 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:12.497264 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.497234 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72e53560-8031-4b38-bcfa-25ad4665c8cd-crio-socket\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:12.497465 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.497324 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks7nr\" (UniqueName: \"kubernetes.io/projected/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-api-access-ks7nr\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:12.497465 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.497352 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:12.497465 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.497373 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72e53560-8031-4b38-bcfa-25ad4665c8cd-crio-socket\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:12.497465 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.497410 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e53560-8031-4b38-bcfa-25ad4665c8cd-data-volume\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:12.497465 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.497445 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:12.497697 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:12.497486 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 19:24:12.497697 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:12.497529 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 19:24:12.497697 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:12.497550 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls podName:72e53560-8031-4b38-bcfa-25ad4665c8cd nodeName:}" failed. No retries permitted until 2026-07-12 19:24:12.997530422 +0000 UTC m=+252.531518581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98rvr" (UID: "72e53560-8031-4b38-bcfa-25ad4665c8cd") : secret "insights-runtime-extractor-tls" not found Jul 12 19:24:12.497697 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:12.497589 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm podName:72e53560-8031-4b38-bcfa-25ad4665c8cd nodeName:}" failed. No retries permitted until 2026-07-12 19:24:12.997570371 +0000 UTC m=+252.531558530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-98rvr" (UID: "72e53560-8031-4b38-bcfa-25ad4665c8cd") : configmap "kube-rbac-proxy" not found Jul 12 19:24:12.497838 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.497735 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e53560-8031-4b38-bcfa-25ad4665c8cd-data-volume\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:12.507325 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.507301 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c49ft"] Jul 12 19:24:12.510260 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.510244 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c49ft" Jul 12 19:24:12.512763 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.512739 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 12 19:24:12.512852 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.512825 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-clgsm\"" Jul 12 19:24:12.512922 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.512878 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 12 19:24:12.513055 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.513034 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks7nr\" (UniqueName: \"kubernetes.io/projected/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-api-access-ks7nr\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:12.521053 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.521026 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c49ft"] Jul 12 19:24:12.598410 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.598336 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-496pn\" (UniqueName: \"kubernetes.io/projected/5fdefaa7-1021-4bbd-8050-8c4e72e7854a-kube-api-access-496pn\") pod \"migrator-7f59b54f6c-c49ft\" (UID: \"5fdefaa7-1021-4bbd-8050-8c4e72e7854a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c49ft" Jul 12 19:24:12.699198 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.699163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-496pn\" (UniqueName: \"kubernetes.io/projected/5fdefaa7-1021-4bbd-8050-8c4e72e7854a-kube-api-access-496pn\") pod \"migrator-7f59b54f6c-c49ft\" (UID: \"5fdefaa7-1021-4bbd-8050-8c4e72e7854a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c49ft" Jul 12 19:24:12.699385 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.699204 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:24:12.699385 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:12.699350 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 12 19:24:12.699462 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:12.699402 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs podName:9b658735-f326-4144-a145-c33b84cff253 nodeName:}" failed. No retries permitted until 2026-07-12 19:26:14.699387722 +0000 UTC m=+374.233375875 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs") pod "network-metrics-daemon-5t7x2" (UID: "9b658735-f326-4144-a145-c33b84cff253") : secret "metrics-daemon-secret" not found Jul 12 19:24:12.706797 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.706777 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-496pn\" (UniqueName: \"kubernetes.io/projected/5fdefaa7-1021-4bbd-8050-8c4e72e7854a-kube-api-access-496pn\") pod \"migrator-7f59b54f6c-c49ft\" (UID: \"5fdefaa7-1021-4bbd-8050-8c4e72e7854a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c49ft" Jul 12 19:24:12.826237 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.826212 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c49ft" Jul 12 19:24:12.952800 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:12.952716 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c49ft"] Jul 12 19:24:12.955479 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:24:12.955449 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fdefaa7_1021_4bbd_8050_8c4e72e7854a.slice/crio-c87ab1042782a467179d26bdf65fe68af8d9b2e3ef1017063bbee0506fafa163 WatchSource:0}: Error finding container c87ab1042782a467179d26bdf65fe68af8d9b2e3ef1017063bbee0506fafa163: Status 404 returned error can't find the container with id c87ab1042782a467179d26bdf65fe68af8d9b2e3ef1017063bbee0506fafa163 Jul 12 19:24:13.002044 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:13.001832 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:13.002044 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:13.001938 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:13.002044 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:13.001992 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 19:24:13.002443 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:13.002068 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 19:24:13.002443 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:13.002069 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls podName:72e53560-8031-4b38-bcfa-25ad4665c8cd nodeName:}" failed. No retries permitted until 2026-07-12 19:24:14.002047778 +0000 UTC m=+253.536035935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98rvr" (UID: "72e53560-8031-4b38-bcfa-25ad4665c8cd") : secret "insights-runtime-extractor-tls" not found Jul 12 19:24:13.002443 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:13.002138 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm podName:72e53560-8031-4b38-bcfa-25ad4665c8cd nodeName:}" failed. No retries permitted until 2026-07-12 19:24:14.002120694 +0000 UTC m=+253.536108848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-98rvr" (UID: "72e53560-8031-4b38-bcfa-25ad4665c8cd") : configmap "kube-rbac-proxy" not found Jul 12 19:24:13.821065 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:13.821031 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c49ft" event={"ID":"5fdefaa7-1021-4bbd-8050-8c4e72e7854a","Type":"ContainerStarted","Data":"c87ab1042782a467179d26bdf65fe68af8d9b2e3ef1017063bbee0506fafa163"} Jul 12 19:24:14.010420 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:14.010398 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:14.010540 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:14.010503 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:14.010540 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:14.010511 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 19:24:14.010642 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:14.010566 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm podName:72e53560-8031-4b38-bcfa-25ad4665c8cd nodeName:}" failed. No retries permitted until 2026-07-12 19:24:16.010551912 +0000 UTC m=+255.544540066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-98rvr" (UID: "72e53560-8031-4b38-bcfa-25ad4665c8cd") : configmap "kube-rbac-proxy" not found Jul 12 19:24:14.010704 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:14.010652 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 19:24:14.010752 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:14.010711 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls podName:72e53560-8031-4b38-bcfa-25ad4665c8cd nodeName:}" failed. No retries permitted until 2026-07-12 19:24:16.010694371 +0000 UTC m=+255.544682538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98rvr" (UID: "72e53560-8031-4b38-bcfa-25ad4665c8cd") : secret "insights-runtime-extractor-tls" not found Jul 12 19:24:14.472239 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:14.472214 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xwlc6_f3efc208-7053-4f82-bcc6-6ee65940f9c5/dns-node-resolver/0.log" Jul 12 19:24:14.826253 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:14.826171 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c49ft" event={"ID":"5fdefaa7-1021-4bbd-8050-8c4e72e7854a","Type":"ContainerStarted","Data":"6421baa957198aa03e810357d057c9d7dbdffe1b8ab61d2829b498878e1757c5"} Jul 12 19:24:14.826253 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:14.826220 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c49ft" event={"ID":"5fdefaa7-1021-4bbd-8050-8c4e72e7854a","Type":"ContainerStarted","Data":"1a85fd4de5b5e8c361fc7f5d3a5ccbcb5bdfdd552d2b507e3ce878e3ec2777c0"} Jul 12 19:24:14.843507 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:14.843461 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c49ft" podStartSLOduration=1.908386369 podStartE2EDuration="2.843448569s" totalImagesPullingTime="935.0622ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:24:14.841634851 +0000 UTC m=+254.375623029" watchObservedRunningTime="2026-07-12 19:24:14.843448569 +0000 UTC m=+254.377436786" Jul 12 19:24:15.072655 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:15.072627 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5pdfz_177e5598-3546-4a59-aca8-47ea7fd504a3/node-ca/0.log" Jul 12 19:24:15.624406 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:15.624369 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-t92kk\" (UID: \"30f415e8-a1ee-40c8-972b-c88fe2d30530\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:15.624406 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:15.624408 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lp4m9\" (UID: \"58523a33-411c-4650-b42c-d2f543a29841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" Jul 12 19:24:15.624629 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:15.624521 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 19:24:15.624629 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:15.624524 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 19:24:15.624629 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:15.624573 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls podName:58523a33-411c-4650-b42c-d2f543a29841 nodeName:}" failed. No retries permitted until 2026-07-12 19:24:23.624559832 +0000 UTC m=+263.158547986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls") pod "cluster-samples-operator-65db858894-lp4m9" (UID: "58523a33-411c-4650-b42c-d2f543a29841") : secret "samples-operator-tls" not found Jul 12 19:24:15.624629 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:15.624585 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls podName:30f415e8-a1ee-40c8-972b-c88fe2d30530 nodeName:}" failed. No retries permitted until 2026-07-12 19:24:23.624579704 +0000 UTC m=+263.158567857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-t92kk" (UID: "30f415e8-a1ee-40c8-972b-c88fe2d30530") : secret "cluster-monitoring-operator-tls" not found Jul 12 19:24:16.027001 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:16.026918 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:16.027371 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:16.027018 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:16.027371 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:16.027044 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 19:24:16.027371 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:16.027107 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm podName:72e53560-8031-4b38-bcfa-25ad4665c8cd nodeName:}" failed. No retries permitted until 2026-07-12 19:24:20.027091055 +0000 UTC m=+259.561079209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-98rvr" (UID: "72e53560-8031-4b38-bcfa-25ad4665c8cd") : configmap "kube-rbac-proxy" not found Jul 12 19:24:16.027371 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:16.027156 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 19:24:16.027371 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:16.027212 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls podName:72e53560-8031-4b38-bcfa-25ad4665c8cd nodeName:}" failed. No retries permitted until 2026-07-12 19:24:20.027199339 +0000 UTC m=+259.561187493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98rvr" (UID: "72e53560-8031-4b38-bcfa-25ad4665c8cd") : secret "insights-runtime-extractor-tls" not found Jul 12 19:24:16.273179 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:16.273143 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zmnpn_f6c11714-ec96-445c-8eff-3b3c33906653/serve-healthcheck-canary/0.log" Jul 12 19:24:20.059585 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:20.059547 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:20.059999 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:20.059626 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:20.059999 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:20.059669 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 19:24:20.059999 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:20.059734 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm podName:72e53560-8031-4b38-bcfa-25ad4665c8cd nodeName:}" failed. No retries permitted until 2026-07-12 19:24:28.059716476 +0000 UTC m=+267.593704629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-98rvr" (UID: "72e53560-8031-4b38-bcfa-25ad4665c8cd") : configmap "kube-rbac-proxy" not found Jul 12 19:24:20.059999 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:20.059736 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 19:24:20.059999 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:20.059777 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls podName:72e53560-8031-4b38-bcfa-25ad4665c8cd nodeName:}" failed. No retries permitted until 2026-07-12 19:24:28.059766079 +0000 UTC m=+267.593754232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98rvr" (UID: "72e53560-8031-4b38-bcfa-25ad4665c8cd") : secret "insights-runtime-extractor-tls" not found Jul 12 19:24:23.690998 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:23.690912 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lp4m9\" (UID: \"58523a33-411c-4650-b42c-d2f543a29841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" Jul 12 19:24:23.691391 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:23.691023 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-t92kk\" (UID: \"30f415e8-a1ee-40c8-972b-c88fe2d30530\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:23.691391 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:23.691113 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 19:24:23.691391 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:23.691177 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls podName:30f415e8-a1ee-40c8-972b-c88fe2d30530 nodeName:}" failed. No retries permitted until 2026-07-12 19:24:39.691160004 +0000 UTC m=+279.225148157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-t92kk" (UID: "30f415e8-a1ee-40c8-972b-c88fe2d30530") : secret "cluster-monitoring-operator-tls" not found Jul 12 19:24:23.693482 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:23.693457 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58523a33-411c-4650-b42c-d2f543a29841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lp4m9\" (UID: \"58523a33-411c-4650-b42c-d2f543a29841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" Jul 12 19:24:23.767250 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:23.767215 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" Jul 12 19:24:23.893201 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:23.893169 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9"] Jul 12 19:24:24.858028 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:24.857996 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" event={"ID":"58523a33-411c-4650-b42c-d2f543a29841","Type":"ContainerStarted","Data":"0760c1d00738bcb44f6e902242a6292c46ed0a1e0970e31007d24393e118c4fd"} Jul 12 19:24:25.866026 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:25.865987 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" event={"ID":"58523a33-411c-4650-b42c-d2f543a29841","Type":"ContainerStarted","Data":"d1dd641360adc5633e4362c58f1f35c446dec0d16baf8bafde03688ce66acb83"} Jul 12 19:24:25.866401 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:25.866050 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" event={"ID":"58523a33-411c-4650-b42c-d2f543a29841","Type":"ContainerStarted","Data":"613bd230665c657a8d5624400ef522b7271195f600192f5ae88f1a406b1d7c01"} Jul 12 19:24:25.881271 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:25.880596 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lp4m9" podStartSLOduration=17.10520122 podStartE2EDuration="18.880577128s" totalImagesPullingTime="1.775375908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:24:25.880165499 +0000 UTC m=+265.414153674" watchObservedRunningTime="2026-07-12 19:24:25.880577128 +0000 UTC m=+265.414565304" Jul 12 19:24:28.127947 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:28.127911 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:28.128448 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:28.127975 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:28.128448 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:28.128065 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 19:24:28.128448 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:28.128117 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls podName:72e53560-8031-4b38-bcfa-25ad4665c8cd nodeName:}" failed. No retries permitted until 2026-07-12 19:24:44.12810453 +0000 UTC m=+283.662092683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98rvr" (UID: "72e53560-8031-4b38-bcfa-25ad4665c8cd") : secret "insights-runtime-extractor-tls" not found Jul 12 19:24:28.128626 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:28.128586 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72e53560-8031-4b38-bcfa-25ad4665c8cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:34.855087 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.855046 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bd5759bb9-x2rlf"] Jul 12 19:24:34.858195 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.858179 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:34.861065 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.861042 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-29mst\"" Jul 12 19:24:34.861195 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.861102 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 12 19:24:34.861195 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.861156 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 12 19:24:34.862109 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.862090 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 12 19:24:34.866134 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.866116 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 12 19:24:34.870744 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.870723 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bd5759bb9-x2rlf"] Jul 12 19:24:34.977428 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.977399 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvm8s\" (UniqueName: \"kubernetes.io/projected/0439af22-5960-4616-b8f2-fb40f229e836-kube-api-access-pvm8s\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:34.977591 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.977452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0439af22-5960-4616-b8f2-fb40f229e836-trusted-ca\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:34.977591 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.977501 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0439af22-5960-4616-b8f2-fb40f229e836-installation-pull-secrets\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:34.977591 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.977547 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0439af22-5960-4616-b8f2-fb40f229e836-registry-tls\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:34.977591 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.977567 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0439af22-5960-4616-b8f2-fb40f229e836-bound-sa-token\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:34.977591 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.977584 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0439af22-5960-4616-b8f2-fb40f229e836-registry-certificates\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:34.977824 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.977640 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0439af22-5960-4616-b8f2-fb40f229e836-ca-trust-extracted\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:34.977824 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:34.977721 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0439af22-5960-4616-b8f2-fb40f229e836-image-registry-private-configuration\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.078475 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.078447 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0439af22-5960-4616-b8f2-fb40f229e836-trusted-ca\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.078684 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.078482 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0439af22-5960-4616-b8f2-fb40f229e836-installation-pull-secrets\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.078684 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.078516 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0439af22-5960-4616-b8f2-fb40f229e836-registry-tls\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.078684 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.078540 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0439af22-5960-4616-b8f2-fb40f229e836-bound-sa-token\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.078684 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.078561 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0439af22-5960-4616-b8f2-fb40f229e836-registry-certificates\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.078889 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.078732 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0439af22-5960-4616-b8f2-fb40f229e836-ca-trust-extracted\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.078889 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.078796 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0439af22-5960-4616-b8f2-fb40f229e836-image-registry-private-configuration\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.078889 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.078851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvm8s\" (UniqueName: \"kubernetes.io/projected/0439af22-5960-4616-b8f2-fb40f229e836-kube-api-access-pvm8s\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.079129 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.079104 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0439af22-5960-4616-b8f2-fb40f229e836-ca-trust-extracted\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.079438 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.079420 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0439af22-5960-4616-b8f2-fb40f229e836-registry-certificates\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.079718 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.079702 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0439af22-5960-4616-b8f2-fb40f229e836-trusted-ca\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.081172 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.081154 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0439af22-5960-4616-b8f2-fb40f229e836-registry-tls\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.081557 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.081537 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0439af22-5960-4616-b8f2-fb40f229e836-image-registry-private-configuration\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.081626 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.081603 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0439af22-5960-4616-b8f2-fb40f229e836-installation-pull-secrets\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.088250 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.088223 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0439af22-5960-4616-b8f2-fb40f229e836-bound-sa-token\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.088362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.088315 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvm8s\" (UniqueName: \"kubernetes.io/projected/0439af22-5960-4616-b8f2-fb40f229e836-kube-api-access-pvm8s\") pod \"image-registry-5bd5759bb9-x2rlf\" (UID: \"0439af22-5960-4616-b8f2-fb40f229e836\") " pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.167436 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.167408 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.293084 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.293061 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bd5759bb9-x2rlf"] Jul 12 19:24:35.295345 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:24:35.295320 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0439af22_5960_4616_b8f2_fb40f229e836.slice/crio-eedf2062c5abc85e1cce11687a588b6623ed3432cebba6e4dd598c2741f2f65d WatchSource:0}: Error finding container eedf2062c5abc85e1cce11687a588b6623ed3432cebba6e4dd598c2741f2f65d: Status 404 returned error can't find the container with id eedf2062c5abc85e1cce11687a588b6623ed3432cebba6e4dd598c2741f2f65d Jul 12 19:24:35.899305 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.899249 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" event={"ID":"0439af22-5960-4616-b8f2-fb40f229e836","Type":"ContainerStarted","Data":"8cdca9727784ff347a0e3d7f80310e2a931fcacbf890e98d115851c14c0f0919"} Jul 12 19:24:35.899305 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.899312 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" event={"ID":"0439af22-5960-4616-b8f2-fb40f229e836","Type":"ContainerStarted","Data":"eedf2062c5abc85e1cce11687a588b6623ed3432cebba6e4dd598c2741f2f65d"} Jul 12 19:24:35.899753 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.899372 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:35.917156 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:35.917111 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" podStartSLOduration=1.9170986540000001 podStartE2EDuration="1.917098654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:24:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:24:35.916330103 +0000 UTC m=+275.450318279" watchObservedRunningTime="2026-07-12 19:24:35.917098654 +0000 UTC m=+275.451086828" Jul 12 19:24:39.716486 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:39.716444 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-t92kk\" (UID: \"30f415e8-a1ee-40c8-972b-c88fe2d30530\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:39.719091 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:39.719066 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/30f415e8-a1ee-40c8-972b-c88fe2d30530-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-t92kk\" (UID: \"30f415e8-a1ee-40c8-972b-c88fe2d30530\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:39.954157 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:39.954121 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" Jul 12 19:24:40.080332 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:40.080302 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk"] Jul 12 19:24:40.083084 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:24:40.083056 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f415e8_a1ee_40c8_972b_c88fe2d30530.slice/crio-c19ce5e3860f59965c03e2a95a8565e6aa23c87e5e61a22c53324676b48856d4 WatchSource:0}: Error finding container c19ce5e3860f59965c03e2a95a8565e6aa23c87e5e61a22c53324676b48856d4: Status 404 returned error can't find the container with id c19ce5e3860f59965c03e2a95a8565e6aa23c87e5e61a22c53324676b48856d4 Jul 12 19:24:40.914780 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:40.914746 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" event={"ID":"30f415e8-a1ee-40c8-972b-c88fe2d30530","Type":"ContainerStarted","Data":"c19ce5e3860f59965c03e2a95a8565e6aa23c87e5e61a22c53324676b48856d4"} Jul 12 19:24:41.919267 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:41.919233 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" event={"ID":"30f415e8-a1ee-40c8-972b-c88fe2d30530","Type":"ContainerStarted","Data":"731b7a31b145e2a283f8ef49e71b5c0e40871b02f93b92532551be989c6284c1"} Jul 12 19:24:41.934982 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:41.934926 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-t92kk" podStartSLOduration=33.404951364 podStartE2EDuration="34.934907349s" totalImagesPullingTime="1.529955985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:24:41.933980984 +0000 UTC m=+281.467969161" watchObservedRunningTime="2026-07-12 19:24:41.934907349 +0000 UTC m=+281.468895528" Jul 12 19:24:42.073351 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:42.073275 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wg8md"] Jul 12 19:24:42.076331 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:42.076315 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wg8md" Jul 12 19:24:42.078890 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:42.078860 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 12 19:24:42.079003 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:42.078904 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-b26kk\"" Jul 12 19:24:42.084409 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:42.084382 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wg8md"] Jul 12 19:24:42.136310 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:42.136257 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae0a81c9-62bb-4970-8852-f86cf010b72f-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wg8md\" (UID: \"ae0a81c9-62bb-4970-8852-f86cf010b72f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wg8md" Jul 12 19:24:42.237206 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:42.237125 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae0a81c9-62bb-4970-8852-f86cf010b72f-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wg8md\" (UID: \"ae0a81c9-62bb-4970-8852-f86cf010b72f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wg8md" Jul 12 19:24:42.239725 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:42.239700 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae0a81c9-62bb-4970-8852-f86cf010b72f-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wg8md\" (UID: \"ae0a81c9-62bb-4970-8852-f86cf010b72f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wg8md" Jul 12 19:24:42.386481 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:42.386451 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wg8md" Jul 12 19:24:42.507397 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:42.507330 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wg8md"] Jul 12 19:24:42.510131 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:24:42.510108 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0a81c9_62bb_4970_8852_f86cf010b72f.slice/crio-857d92025fe71aec4c990898991526938ec69a27f36609398509b30de7c67819 WatchSource:0}: Error finding container 857d92025fe71aec4c990898991526938ec69a27f36609398509b30de7c67819: Status 404 returned error can't find the container with id 857d92025fe71aec4c990898991526938ec69a27f36609398509b30de7c67819 Jul 12 19:24:42.923650 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:42.923617 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wg8md" event={"ID":"ae0a81c9-62bb-4970-8852-f86cf010b72f","Type":"ContainerStarted","Data":"857d92025fe71aec4c990898991526938ec69a27f36609398509b30de7c67819"} Jul 12 19:24:43.595769 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:43.595726 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kcrwk" podUID="37a6f7e0-6c8e-47db-b215-c38182a2a58d" Jul 12 19:24:43.928074 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:43.928046 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kcrwk" Jul 12 19:24:43.928494 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:43.928076 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wg8md" event={"ID":"ae0a81c9-62bb-4970-8852-f86cf010b72f","Type":"ContainerStarted","Data":"fa9a48db54938cf6b1f0a03e2b89b314b1ed5c44e89970eabdd65d9a08230c5e"} Jul 12 19:24:43.928494 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:43.928170 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wg8md" Jul 12 19:24:43.932790 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:43.932773 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wg8md" Jul 12 19:24:43.965307 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:43.962886 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wg8md" podStartSLOduration=0.892461176 podStartE2EDuration="1.962866065s" totalImagesPullingTime="1.070404889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:24:43.94180371 +0000 UTC m=+283.475791884" watchObservedRunningTime="2026-07-12 19:24:43.962866065 +0000 UTC m=+283.496854241" Jul 12 19:24:44.152906 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:44.152875 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:44.155274 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:44.155256 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e53560-8031-4b38-bcfa-25ad4665c8cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98rvr\" (UID: \"72e53560-8031-4b38-bcfa-25ad4665c8cd\") " pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:44.391370 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:44.391337 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-98rvr" Jul 12 19:24:44.518411 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:44.518378 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-98rvr"] Jul 12 19:24:44.521277 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:24:44.521246 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e53560_8031_4b38_bcfa_25ad4665c8cd.slice/crio-405c8fabea281251a2979078684f7d016bc17c03a61625aef7ac9e2b28512545 WatchSource:0}: Error finding container 405c8fabea281251a2979078684f7d016bc17c03a61625aef7ac9e2b28512545: Status 404 returned error can't find the container with id 405c8fabea281251a2979078684f7d016bc17c03a61625aef7ac9e2b28512545 Jul 12 19:24:44.932361 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:44.932320 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98rvr" event={"ID":"72e53560-8031-4b38-bcfa-25ad4665c8cd","Type":"ContainerStarted","Data":"405c8fabea281251a2979078684f7d016bc17c03a61625aef7ac9e2b28512545"} Jul 12 19:24:46.775852 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:46.775817 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:24:46.778623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:46.778600 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6f7e0-6c8e-47db-b215-c38182a2a58d-metrics-tls\") pod \"dns-default-kcrwk\" (UID: \"37a6f7e0-6c8e-47db-b215-c38182a2a58d\") " pod="openshift-dns/dns-default-kcrwk" Jul 12 19:24:46.931985 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:46.931943 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qvb27\"" Jul 12 19:24:46.939838 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:46.939533 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kcrwk" Jul 12 19:24:48.526703 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:48.526673 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kcrwk"] Jul 12 19:24:48.529687 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:24:48.529660 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a6f7e0_6c8e_47db_b215_c38182a2a58d.slice/crio-9fa1a554f83b41d82e35910899437004c82b200f86be0f5df5ae23961646a9ab WatchSource:0}: Error finding container 9fa1a554f83b41d82e35910899437004c82b200f86be0f5df5ae23961646a9ab: Status 404 returned error can't find the container with id 9fa1a554f83b41d82e35910899437004c82b200f86be0f5df5ae23961646a9ab Jul 12 19:24:48.950239 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:48.950200 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kcrwk" event={"ID":"37a6f7e0-6c8e-47db-b215-c38182a2a58d","Type":"ContainerStarted","Data":"9fa1a554f83b41d82e35910899437004c82b200f86be0f5df5ae23961646a9ab"} Jul 12 19:24:48.952020 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:48.951992 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98rvr" event={"ID":"72e53560-8031-4b38-bcfa-25ad4665c8cd","Type":"ContainerStarted","Data":"7d30cd7dab074ecfe59525054a79c63f3770ea7c44eb187a4572d36f37f59e6e"} Jul 12 19:24:49.493540 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.493501 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gbtrg"] Jul 12 19:24:49.496266 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.496242 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.499124 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.498974 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 12 19:24:49.499124 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.498988 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 12 19:24:49.499124 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.499074 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5d6qj\"" Jul 12 19:24:49.499124 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.499090 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 12 19:24:49.499464 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.499227 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 12 19:24:49.598023 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.597986 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-textfile\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.598494 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.598031 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26508366-f163-4cfe-ba39-c05a41514d49-metrics-client-ca\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.598494 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.598057 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26508366-f163-4cfe-ba39-c05a41514d49-sys\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.598494 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.598093 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.598494 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.598117 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx6qq\" (UniqueName: \"kubernetes.io/projected/26508366-f163-4cfe-ba39-c05a41514d49-kube-api-access-rx6qq\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.598494 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.598133 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-wtmp\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.598494 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.598152 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-accelerators-collector-config\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.598494 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.598176 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/26508366-f163-4cfe-ba39-c05a41514d49-root\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.598494 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.598348 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-tls\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.698744 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.698708 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-tls\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.698922 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.698777 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-textfile\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.698922 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.698805 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26508366-f163-4cfe-ba39-c05a41514d49-metrics-client-ca\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.698922 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.698831 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26508366-f163-4cfe-ba39-c05a41514d49-sys\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.698922 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.698861 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.698922 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.698888 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx6qq\" (UniqueName: \"kubernetes.io/projected/26508366-f163-4cfe-ba39-c05a41514d49-kube-api-access-rx6qq\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.698922 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.698915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-wtmp\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.699235 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.698944 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-accelerators-collector-config\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.699235 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.698969 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/26508366-f163-4cfe-ba39-c05a41514d49-root\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.699235 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.699110 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/26508366-f163-4cfe-ba39-c05a41514d49-root\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.699235 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:49.699214 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 12 19:24:49.699450 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:49.699269 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-tls podName:26508366-f163-4cfe-ba39-c05a41514d49 nodeName:}" failed. No retries permitted until 2026-07-12 19:24:50.199250673 +0000 UTC m=+289.733238826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-tls") pod "node-exporter-gbtrg" (UID: "26508366-f163-4cfe-ba39-c05a41514d49") : secret "node-exporter-tls" not found Jul 12 19:24:49.700940 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.700910 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26508366-f163-4cfe-ba39-c05a41514d49-sys\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.701212 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.701166 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-wtmp\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.701648 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.701626 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26508366-f163-4cfe-ba39-c05a41514d49-metrics-client-ca\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.701804 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.701780 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-textfile\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.701988 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.701951 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-accelerators-collector-config\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.704656 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.704630 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.711511 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.711486 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx6qq\" (UniqueName: \"kubernetes.io/projected/26508366-f163-4cfe-ba39-c05a41514d49-kube-api-access-rx6qq\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:49.958326 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:49.958231 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98rvr" event={"ID":"72e53560-8031-4b38-bcfa-25ad4665c8cd","Type":"ContainerStarted","Data":"a33b8f4fc8c6cbf4c4f03a1e38cf5238bdeaa66057e137c1061f4113d175ab34"} Jul 12 19:24:50.203352 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.202664 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-tls\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:50.205721 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.205696 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/26508366-f163-4cfe-ba39-c05a41514d49-node-exporter-tls\") pod \"node-exporter-gbtrg\" (UID: \"26508366-f163-4cfe-ba39-c05a41514d49\") " pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:50.409986 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.409954 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gbtrg" Jul 12 19:24:50.421549 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:24:50.421512 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26508366_f163_4cfe_ba39_c05a41514d49.slice/crio-25c6fe4fc5c010b838b8719005b9813f5e6e716971f465ad604d41843210fcb7 WatchSource:0}: Error finding container 25c6fe4fc5c010b838b8719005b9813f5e6e716971f465ad604d41843210fcb7: Status 404 returned error can't find the container with id 25c6fe4fc5c010b838b8719005b9813f5e6e716971f465ad604d41843210fcb7 Jul 12 19:24:50.539524 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.539454 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 19:24:50.543338 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.543313 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.546165 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.546081 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 12 19:24:50.546165 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.546087 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 12 19:24:50.546865 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.546107 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 12 19:24:50.546865 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.546444 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 12 19:24:50.546865 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.546493 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jngln\"" Jul 12 19:24:50.546865 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.546499 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 12 19:24:50.546865 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.546544 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 12 19:24:50.546865 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.546499 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 12 19:24:50.546865 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.546717 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 12 19:24:50.546865 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.546776 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 12 19:24:50.558095 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.558069 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 19:24:50.605877 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.605839 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.606351 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.605909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.606351 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.605954 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.606351 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.605982 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/280ee0d4-4dfc-45a3-9dc9-103a196a4797-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.606351 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.606008 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-config-volume\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.606351 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.606047 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.606351 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.606071 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/280ee0d4-4dfc-45a3-9dc9-103a196a4797-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.606351 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.606128 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/280ee0d4-4dfc-45a3-9dc9-103a196a4797-tls-assets\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.606351 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.606147 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/280ee0d4-4dfc-45a3-9dc9-103a196a4797-config-out\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.606351 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.606242 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.606351 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.606309 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-web-config\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.606351 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.606343 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/280ee0d4-4dfc-45a3-9dc9-103a196a4797-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.606810 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.606375 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xjj5\" (UniqueName: \"kubernetes.io/projected/280ee0d4-4dfc-45a3-9dc9-103a196a4797-kube-api-access-6xjj5\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.707060 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.707023 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.707237 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.707069 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/280ee0d4-4dfc-45a3-9dc9-103a196a4797-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.707331 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.707263 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/280ee0d4-4dfc-45a3-9dc9-103a196a4797-tls-assets\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.707331 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.707323 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/280ee0d4-4dfc-45a3-9dc9-103a196a4797-config-out\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.707443 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.707394 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.707443 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.707436 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-web-config\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.707551 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.707467 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/280ee0d4-4dfc-45a3-9dc9-103a196a4797-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.707551 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.707500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xjj5\" (UniqueName: \"kubernetes.io/projected/280ee0d4-4dfc-45a3-9dc9-103a196a4797-kube-api-access-6xjj5\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.707551 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.707539 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.707692 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.707570 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.707692 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.707597 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.707692 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.707621 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/280ee0d4-4dfc-45a3-9dc9-103a196a4797-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.707692 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.707647 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-config-volume\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.708501 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.708165 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/280ee0d4-4dfc-45a3-9dc9-103a196a4797-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.708902 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.708854 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/280ee0d4-4dfc-45a3-9dc9-103a196a4797-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.709338 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:50.709316 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/280ee0d4-4dfc-45a3-9dc9-103a196a4797-alertmanager-trusted-ca-bundle podName:280ee0d4-4dfc-45a3-9dc9-103a196a4797 nodeName:}" failed. No retries permitted until 2026-07-12 19:24:51.209268041 +0000 UTC m=+290.743256197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/280ee0d4-4dfc-45a3-9dc9-103a196a4797-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "280ee0d4-4dfc-45a3-9dc9-103a196a4797") : configmap references non-existent config key: ca-bundle.crt Jul 12 19:24:50.712044 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.711525 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.712044 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.711936 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-config-volume\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.713466 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.712622 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.713466 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.712635 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.713466 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.712881 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/280ee0d4-4dfc-45a3-9dc9-103a196a4797-tls-assets\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.713466 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.713040 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/280ee0d4-4dfc-45a3-9dc9-103a196a4797-config-out\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.714400 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.714378 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-web-config\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.714501 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.714399 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.715237 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.715211 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.718109 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.718088 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xjj5\" (UniqueName: \"kubernetes.io/projected/280ee0d4-4dfc-45a3-9dc9-103a196a4797-kube-api-access-6xjj5\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:50.963972 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.963932 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kcrwk" event={"ID":"37a6f7e0-6c8e-47db-b215-c38182a2a58d","Type":"ContainerStarted","Data":"a5d2055ba073afd47399599f8937bfdb1d754392739090e89208f8583da0691d"} Jul 12 19:24:50.964148 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.964000 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kcrwk" event={"ID":"37a6f7e0-6c8e-47db-b215-c38182a2a58d","Type":"ContainerStarted","Data":"1dba4acfa7aa9e0ebf3c3f431df9fc394cf8061eb53d09ced250cb4cae798223"} Jul 12 19:24:50.964215 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.964144 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kcrwk" Jul 12 19:24:50.965447 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.965412 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gbtrg" event={"ID":"26508366-f163-4cfe-ba39-c05a41514d49","Type":"ContainerStarted","Data":"25c6fe4fc5c010b838b8719005b9813f5e6e716971f465ad604d41843210fcb7"} Jul 12 19:24:50.983575 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:50.983524 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kcrwk" podStartSLOduration=253.385653656 podStartE2EDuration="4m14.983506278s" totalImagesPullingTime="1.597852622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:24:50.983389017 +0000 UTC m=+290.517377194" watchObservedRunningTime="2026-07-12 19:24:50.983506278 +0000 UTC m=+290.517494456" Jul 12 19:24:51.211107 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:51.211054 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/280ee0d4-4dfc-45a3-9dc9-103a196a4797-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:51.212347 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:51.212311 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/280ee0d4-4dfc-45a3-9dc9-103a196a4797-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:51.454593 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:51.454554 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:24:51.769867 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:51.769771 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 19:24:51.771097 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:24:51.771058 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280ee0d4_4dfc_45a3_9dc9_103a196a4797.slice/crio-1e1f2d93dec46556e4183b91da875bb0cdf0e79d07a9cbfd8ea071cf02ec66fd WatchSource:0}: Error finding container 1e1f2d93dec46556e4183b91da875bb0cdf0e79d07a9cbfd8ea071cf02ec66fd: Status 404 returned error can't find the container with id 1e1f2d93dec46556e4183b91da875bb0cdf0e79d07a9cbfd8ea071cf02ec66fd Jul 12 19:24:51.972034 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:51.971932 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98rvr" event={"ID":"72e53560-8031-4b38-bcfa-25ad4665c8cd","Type":"ContainerStarted","Data":"1f018a8ad754ce7e1892fd3d418c8ca955a2ba83208cee57d33724c21f20a197"} Jul 12 19:24:51.973498 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:51.973468 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerStarted","Data":"1e1f2d93dec46556e4183b91da875bb0cdf0e79d07a9cbfd8ea071cf02ec66fd"} Jul 12 19:24:51.989052 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:51.989001 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-98rvr" podStartSLOduration=32.953615707 podStartE2EDuration="39.988984358s" totalImagesPullingTime="7.035368651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:24:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:24:51.987590199 +0000 UTC m=+291.521578376" watchObservedRunningTime="2026-07-12 19:24:51.988984358 +0000 UTC m=+291.522972533" Jul 12 19:24:52.465051 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.465015 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-55bdcc978c-bvmp2"] Jul 12 19:24:52.468657 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.468640 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.471379 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.471354 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 12 19:24:52.471379 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.471354 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 12 19:24:52.471615 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.471602 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-47rpsd9a6qcum\"" Jul 12 19:24:52.471809 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.471790 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 12 19:24:52.471889 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.471790 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 12 19:24:52.471889 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.471841 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 12 19:24:52.471889 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.471870 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dxdqv\"" Jul 12 19:24:52.479741 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.479694 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55bdcc978c-bvmp2"] Jul 12 19:24:52.522701 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.522671 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.522701 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.522705 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c451349d-c041-43ff-ac0c-8ebfc14b8594-metrics-client-ca\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.522930 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.522732 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj9ff\" (UniqueName: \"kubernetes.io/projected/c451349d-c041-43ff-ac0c-8ebfc14b8594-kube-api-access-nj9ff\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.522930 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.522812 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-thanos-querier-tls\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.522930 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.522881 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-grpc-tls\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.523079 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.522975 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.523079 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.523006 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.523079 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.523044 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.624021 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.623988 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-thanos-querier-tls\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.624021 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.624029 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-grpc-tls\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.624249 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.624077 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.624249 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.624096 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.624249 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.624117 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.624249 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.624162 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.624249 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.624185 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c451349d-c041-43ff-ac0c-8ebfc14b8594-metrics-client-ca\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.624249 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.624212 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj9ff\" (UniqueName: \"kubernetes.io/projected/c451349d-c041-43ff-ac0c-8ebfc14b8594-kube-api-access-nj9ff\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.625309 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.625260 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c451349d-c041-43ff-ac0c-8ebfc14b8594-metrics-client-ca\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.627392 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.627360 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.627498 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.627367 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.627562 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.627505 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.627617 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.627578 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.627724 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.627702 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-grpc-tls\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.627899 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.627885 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c451349d-c041-43ff-ac0c-8ebfc14b8594-secret-thanos-querier-tls\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.631558 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.631541 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj9ff\" (UniqueName: \"kubernetes.io/projected/c451349d-c041-43ff-ac0c-8ebfc14b8594-kube-api-access-nj9ff\") pod \"thanos-querier-55bdcc978c-bvmp2\" (UID: \"c451349d-c041-43ff-ac0c-8ebfc14b8594\") " pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.778077 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.778000 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:52.978337 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.978302 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerStarted","Data":"1393ff7b2662c98cb03e05bd16d4c50c0417e47483770162e754493d77c1cc38"} Jul 12 19:24:52.979883 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.979858 2572 generic.go:356] "Generic (PLEG): container finished" podID="26508366-f163-4cfe-ba39-c05a41514d49" containerID="2255652f700861fac1c33cb3f4a4b1ce33df2c48a5886e5ab2c69d0c8c059fe8" exitCode=0 Jul 12 19:24:52.979992 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.979917 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gbtrg" event={"ID":"26508366-f163-4cfe-ba39-c05a41514d49","Type":"ContainerDied","Data":"2255652f700861fac1c33cb3f4a4b1ce33df2c48a5886e5ab2c69d0c8c059fe8"} Jul 12 19:24:52.987234 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:52.987214 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55bdcc978c-bvmp2"] Jul 12 19:24:52.990532 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:24:52.990507 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc451349d_c041_43ff_ac0c_8ebfc14b8594.slice/crio-eca2e6beb7644511dbec9ce17200b0507f547ae2108ed0f20c796757933b6002 WatchSource:0}: Error finding container eca2e6beb7644511dbec9ce17200b0507f547ae2108ed0f20c796757933b6002: Status 404 returned error can't find the container with id eca2e6beb7644511dbec9ce17200b0507f547ae2108ed0f20c796757933b6002 Jul 12 19:24:53.770370 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.770339 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-58b55fb974-skzwp"] Jul 12 19:24:53.773538 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.773519 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.776026 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.775994 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 12 19:24:53.776271 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.776246 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 12 19:24:53.777341 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.777300 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 12 19:24:53.777444 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.777355 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nx89r\"" Jul 12 19:24:53.777444 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.777361 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 12 19:24:53.777444 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.777391 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3n6df37tui1hh\"" Jul 12 19:24:53.782717 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.782692 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58b55fb974-skzwp"] Jul 12 19:24:53.838226 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.838184 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tx74\" (UniqueName: \"kubernetes.io/projected/74231b74-f63a-4f29-abaa-3f8dd66adb0f-kube-api-access-2tx74\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.838519 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.838241 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74231b74-f63a-4f29-abaa-3f8dd66adb0f-client-ca-bundle\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.838519 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.838342 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74231b74-f63a-4f29-abaa-3f8dd66adb0f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.838519 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.838426 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/74231b74-f63a-4f29-abaa-3f8dd66adb0f-secret-metrics-server-client-certs\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.838519 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.838471 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/74231b74-f63a-4f29-abaa-3f8dd66adb0f-secret-metrics-server-tls\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.838732 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.838547 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/74231b74-f63a-4f29-abaa-3f8dd66adb0f-metrics-server-audit-profiles\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.838732 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.838574 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/74231b74-f63a-4f29-abaa-3f8dd66adb0f-audit-log\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.939722 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.939690 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/74231b74-f63a-4f29-abaa-3f8dd66adb0f-secret-metrics-server-client-certs\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.939905 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.939750 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/74231b74-f63a-4f29-abaa-3f8dd66adb0f-secret-metrics-server-tls\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.939905 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.939798 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/74231b74-f63a-4f29-abaa-3f8dd66adb0f-metrics-server-audit-profiles\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.939905 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.939827 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/74231b74-f63a-4f29-abaa-3f8dd66adb0f-audit-log\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.939905 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.939870 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tx74\" (UniqueName: \"kubernetes.io/projected/74231b74-f63a-4f29-abaa-3f8dd66adb0f-kube-api-access-2tx74\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.939905 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.939897 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74231b74-f63a-4f29-abaa-3f8dd66adb0f-client-ca-bundle\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.940160 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.939931 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74231b74-f63a-4f29-abaa-3f8dd66adb0f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.941137 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.941020 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74231b74-f63a-4f29-abaa-3f8dd66adb0f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.941314 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.941170 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/74231b74-f63a-4f29-abaa-3f8dd66adb0f-audit-log\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.941678 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.941653 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/74231b74-f63a-4f29-abaa-3f8dd66adb0f-metrics-server-audit-profiles\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.942857 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.942831 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/74231b74-f63a-4f29-abaa-3f8dd66adb0f-secret-metrics-server-client-certs\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.942954 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.942908 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/74231b74-f63a-4f29-abaa-3f8dd66adb0f-secret-metrics-server-tls\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.943775 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.943751 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74231b74-f63a-4f29-abaa-3f8dd66adb0f-client-ca-bundle\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.951016 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.950972 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tx74\" (UniqueName: \"kubernetes.io/projected/74231b74-f63a-4f29-abaa-3f8dd66adb0f-kube-api-access-2tx74\") pod \"metrics-server-58b55fb974-skzwp\" (UID: \"74231b74-f63a-4f29-abaa-3f8dd66adb0f\") " pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:53.986516 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.986479 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gbtrg" event={"ID":"26508366-f163-4cfe-ba39-c05a41514d49","Type":"ContainerStarted","Data":"0b70e1eee037ce56262a5b953c3fedb3d84ccc45b7bbcc76366cd97de95a7f00"} Jul 12 19:24:53.986685 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.986542 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gbtrg" event={"ID":"26508366-f163-4cfe-ba39-c05a41514d49","Type":"ContainerStarted","Data":"09903a892e729d2340d795d2df9b3276c32f4297ca4bf09559a4dc90d45e24c4"} Jul 12 19:24:53.987744 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.987713 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" event={"ID":"c451349d-c041-43ff-ac0c-8ebfc14b8594","Type":"ContainerStarted","Data":"eca2e6beb7644511dbec9ce17200b0507f547ae2108ed0f20c796757933b6002"} Jul 12 19:24:53.989336 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.989303 2572 generic.go:356] "Generic (PLEG): container finished" podID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerID="1393ff7b2662c98cb03e05bd16d4c50c0417e47483770162e754493d77c1cc38" exitCode=0 Jul 12 19:24:53.989450 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:53.989389 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerDied","Data":"1393ff7b2662c98cb03e05bd16d4c50c0417e47483770162e754493d77c1cc38"} Jul 12 19:24:54.004277 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:54.004233 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gbtrg" podStartSLOduration=3.172899855 podStartE2EDuration="5.004218739s" totalImagesPullingTime="1.759760886s" totalInitContainerRuntime="71.557998ms" isStatefulPod=true podCreationTimestamp="2026-07-12 19:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:24:54.003301353 +0000 UTC m=+293.537289524" watchObservedRunningTime="2026-07-12 19:24:54.004218739 +0000 UTC m=+293.538206914" Jul 12 19:24:54.091091 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:54.091003 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:24:54.230137 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:54.230047 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58b55fb974-skzwp"] Jul 12 19:24:54.232626 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:24:54.232595 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74231b74_f63a_4f29_abaa_3f8dd66adb0f.slice/crio-319b214f9bfd04b9c0d91a15cdbdd866a0e71e1314e2a33fb953920f333b45d2 WatchSource:0}: Error finding container 319b214f9bfd04b9c0d91a15cdbdd866a0e71e1314e2a33fb953920f333b45d2: Status 404 returned error can't find the container with id 319b214f9bfd04b9c0d91a15cdbdd866a0e71e1314e2a33fb953920f333b45d2 Jul 12 19:24:54.995954 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:54.995923 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" event={"ID":"74231b74-f63a-4f29-abaa-3f8dd66adb0f","Type":"ContainerStarted","Data":"319b214f9bfd04b9c0d91a15cdbdd866a0e71e1314e2a33fb953920f333b45d2"} Jul 12 19:24:55.000065 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.000037 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" event={"ID":"c451349d-c041-43ff-ac0c-8ebfc14b8594","Type":"ContainerStarted","Data":"6dac0d7b638da2b92884e367e83e19de94691060d109f9cb80feb1c03c2e8b09"} Jul 12 19:24:55.000160 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.000116 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" event={"ID":"c451349d-c041-43ff-ac0c-8ebfc14b8594","Type":"ContainerStarted","Data":"b9850a436e3d7c5b0ed8f21b5a1959f2fdd968b9239f295024d38a54aad0bb59"} Jul 12 19:24:55.173338 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.173275 2572 patch_prober.go:28] interesting pod/image-registry-5bd5759bb9-x2rlf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 12 19:24:55.173507 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.173359 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" podUID="0439af22-5960-4616-b8f2-fb40f229e836" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 12 19:24:55.632095 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.632061 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 12 19:24:55.635964 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.635939 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.640635 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.640598 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 12 19:24:55.640763 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.640637 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 12 19:24:55.640763 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.640598 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 12 19:24:55.640763 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.640674 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jz6zw\"" Jul 12 19:24:55.640763 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.640605 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-929hu787rhj08\"" Jul 12 19:24:55.641345 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.641195 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 12 19:24:55.641345 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.641208 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 12 19:24:55.641345 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.641237 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 12 19:24:55.641345 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.641208 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 12 19:24:55.641605 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.641355 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 12 19:24:55.646096 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.646073 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 12 19:24:55.646313 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.646300 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 12 19:24:55.646455 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.646443 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 12 19:24:55.646634 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.646618 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 12 19:24:55.647453 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.647436 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 12 19:24:55.651234 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.651217 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 12 19:24:55.664025 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.663957 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 12 19:24:55.756706 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.756667 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fb8aebb-8eaf-403b-b5eb-8c9866457731-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.756706 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.756710 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.756940 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.756759 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.756940 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.756789 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl7gh\" (UniqueName: \"kubernetes.io/projected/4fb8aebb-8eaf-403b-b5eb-8c9866457731-kube-api-access-hl7gh\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.756940 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.756819 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fb8aebb-8eaf-403b-b5eb-8c9866457731-config-out\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.756940 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.756861 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.756940 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.756889 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-web-config\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.756940 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.756909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.757239 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.756961 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.757239 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.757072 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.757239 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.757121 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.757239 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.757189 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.757239 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.757216 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.757239 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.757239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.757535 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.757266 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.757535 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.757350 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-config\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.757535 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.757392 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.757535 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.757429 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.757535 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.757455 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.757535 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.757493 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858091 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858057 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858091 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858095 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl7gh\" (UniqueName: \"kubernetes.io/projected/4fb8aebb-8eaf-403b-b5eb-8c9866457731-kube-api-access-hl7gh\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858345 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858115 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fb8aebb-8eaf-403b-b5eb-8c9866457731-config-out\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858345 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858152 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858345 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858193 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-web-config\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858345 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858219 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858345 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858242 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858345 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858267 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858345 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858310 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858345 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858348 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858756 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858369 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858756 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858389 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858756 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858417 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858756 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858443 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-config\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858756 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858756 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858502 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858756 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858525 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858756 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858546 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858756 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858587 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fb8aebb-8eaf-403b-b5eb-8c9866457731-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.858756 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858609 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.859218 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.858932 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.859218 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.859202 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.859362 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.859331 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.860361 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.860330 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.860937 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.860860 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.861193 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.861165 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.861943 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.861917 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-web-config\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.862083 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.862057 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fb8aebb-8eaf-403b-b5eb-8c9866457731-config-out\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.862083 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.862064 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.862212 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.862194 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.862992 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.862924 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.862992 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.862922 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.864090 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.864064 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.864648 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.864593 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.865065 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.865018 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.865636 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.865614 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fb8aebb-8eaf-403b-b5eb-8c9866457731-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.865942 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.865921 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.866034 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.866013 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-config\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.866947 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.866923 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl7gh\" (UniqueName: \"kubernetes.io/projected/4fb8aebb-8eaf-403b-b5eb-8c9866457731-kube-api-access-hl7gh\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.867197 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.867181 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:55.947462 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:55.947377 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:24:56.008121 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:56.008086 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" event={"ID":"c451349d-c041-43ff-ac0c-8ebfc14b8594","Type":"ContainerStarted","Data":"b54092d4d15b66c80e550558864125a314cab1ba0a60dd62fbfa8736aba6a83c"} Jul 12 19:24:56.489205 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:56.489175 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 12 19:24:56.491877 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:24:56.491848 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb8aebb_8eaf_403b_b5eb_8c9866457731.slice/crio-107b58aea784e242bbe7a4c8612833e24e4afcba5099a16405b4f4f8920df6ec WatchSource:0}: Error finding container 107b58aea784e242bbe7a4c8612833e24e4afcba5099a16405b4f4f8920df6ec: Status 404 returned error can't find the container with id 107b58aea784e242bbe7a4c8612833e24e4afcba5099a16405b4f4f8920df6ec Jul 12 19:24:56.907274 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:56.907246 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bd5759bb9-x2rlf" Jul 12 19:24:57.006885 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:24:57.006805 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5t7x2" podUID="9b658735-f326-4144-a145-c33b84cff253" Jul 12 19:24:57.015431 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.015393 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerStarted","Data":"fe788f008be79034da12bf4ab5843aec0b7500cffaf3dfcb6cb1e13a40b4b0ba"} Jul 12 19:24:57.015856 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.015464 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerStarted","Data":"16807a2de7b0aeb5be309bc3519d40869e3951f0c3a6b9f54182bb1fb87189c9"} Jul 12 19:24:57.015856 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.015505 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerStarted","Data":"1bfebaa107162d87dcbb478705fb4fe9bb25f24bd4af1f7171a886ef87000f74"} Jul 12 19:24:57.015856 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.015544 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerStarted","Data":"33f0a3d724bdf19f6895aefae648b3781a1986aeb032985275947e29f6e474ac"} Jul 12 19:24:57.015856 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.015575 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerStarted","Data":"3b1f1970d00e24626045fded1c2f699f7a5b484f05b2e0b28d6e2834fa85c0d8"} Jul 12 19:24:57.015856 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.015599 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerStarted","Data":"21a778044063ee8cee9a80efb645c935e086f4725ec958db9b591bce5ec452e7"} Jul 12 19:24:57.018489 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.018458 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" event={"ID":"c451349d-c041-43ff-ac0c-8ebfc14b8594","Type":"ContainerStarted","Data":"07ad233c67ecb4ec6d19f85f631eea7952bafe3253be2cc90f5b0c540df5112b"} Jul 12 19:24:57.018607 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.018534 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" event={"ID":"c451349d-c041-43ff-ac0c-8ebfc14b8594","Type":"ContainerStarted","Data":"302dbeb4c6a21f501cb63e14d5a818414cdaffd4fc099bb25a80f5e4a118519e"} Jul 12 19:24:57.018607 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.018575 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" event={"ID":"c451349d-c041-43ff-ac0c-8ebfc14b8594","Type":"ContainerStarted","Data":"b43eb5361ad6925538de2b2c20a086637741e71cceb36bdcce81bfb40b6637f8"} Jul 12 19:24:57.018696 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.018623 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:24:57.020160 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.020138 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" event={"ID":"74231b74-f63a-4f29-abaa-3f8dd66adb0f","Type":"ContainerStarted","Data":"533994ce7c511b3544b86b0a5544ad37261fe3f4108e9e71c6a955cd2b9970f5"} Jul 12 19:24:57.021593 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.021568 2572 generic.go:356] "Generic (PLEG): container finished" podID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerID="97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a" exitCode=0 Jul 12 19:24:57.021670 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.021651 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fb8aebb-8eaf-403b-b5eb-8c9866457731","Type":"ContainerDied","Data":"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a"} Jul 12 19:24:57.021733 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.021720 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fb8aebb-8eaf-403b-b5eb-8c9866457731","Type":"ContainerStarted","Data":"107b58aea784e242bbe7a4c8612833e24e4afcba5099a16405b4f4f8920df6ec"} Jul 12 19:24:57.039747 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.039696 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.553772635 podStartE2EDuration="7.039677228s" totalImagesPullingTime="3.467536537s" totalInitContainerRuntime="18.368056ms" isStatefulPod=false podCreationTimestamp="2026-07-12 19:24:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:24:57.038107597 +0000 UTC m=+296.572095771" watchObservedRunningTime="2026-07-12 19:24:57.039677228 +0000 UTC m=+296.573665404" Jul 12 19:24:57.084361 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.084302 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" podStartSLOduration=1.9815902090000002 podStartE2EDuration="4.08426539s" totalImagesPullingTime="2.102675181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:24:57.055561191 +0000 UTC m=+296.589549368" watchObservedRunningTime="2026-07-12 19:24:57.08426539 +0000 UTC m=+296.618253565" Jul 12 19:24:57.104084 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:24:57.104036 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" podStartSLOduration=1.9129919100000001 podStartE2EDuration="5.104020564s" totalImagesPullingTime="3.191028654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:24:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:24:57.103002457 +0000 UTC m=+296.636990645" watchObservedRunningTime="2026-07-12 19:24:57.104020564 +0000 UTC m=+296.638008738" Jul 12 19:25:00.893593 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:00.893568 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 12 19:25:00.975715 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:00.975685 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kcrwk" Jul 12 19:25:01.042871 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:01.042706 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fb8aebb-8eaf-403b-b5eb-8c9866457731","Type":"ContainerStarted","Data":"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269"} Jul 12 19:25:01.042871 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:01.042787 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fb8aebb-8eaf-403b-b5eb-8c9866457731","Type":"ContainerStarted","Data":"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b"} Jul 12 19:25:01.042871 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:01.042824 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fb8aebb-8eaf-403b-b5eb-8c9866457731","Type":"ContainerStarted","Data":"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce"} Jul 12 19:25:01.042871 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:01.042858 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fb8aebb-8eaf-403b-b5eb-8c9866457731","Type":"ContainerStarted","Data":"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa"} Jul 12 19:25:01.065445 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:01.042894 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fb8aebb-8eaf-403b-b5eb-8c9866457731","Type":"ContainerStarted","Data":"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce"} Jul 12 19:25:01.065445 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:01.042929 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fb8aebb-8eaf-403b-b5eb-8c9866457731","Type":"ContainerStarted","Data":"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf"} Jul 12 19:25:01.070036 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:01.069986 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.752720295 podStartE2EDuration="6.069966816s" totalImagesPullingTime="3.288286451s" totalInitContainerRuntime="28.96007ms" isStatefulPod=false podCreationTimestamp="2026-07-12 19:24:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:25:01.067370276 +0000 UTC m=+300.601358453" watchObservedRunningTime="2026-07-12 19:25:01.069966816 +0000 UTC m=+300.603954991" Jul 12 19:25:03.032954 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:03.032925 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-55bdcc978c-bvmp2" Jul 12 19:25:05.948502 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:05.948458 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:25:08.005876 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:08.005846 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:25:14.091847 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:14.091809 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:25:14.092343 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:14.091898 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:25:21.599724 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:25:21.599692 2572 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8524be03_4385_4b02_a94c_3828707d13d5.slice/crio-conmon-e97cb6c5a581694574945076e0b555b1aa82782f85b756d8e263bae71787f1d9.scope\": RecentStats: unable to find data in memory cache]" Jul 12 19:25:22.130114 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:22.130085 2572 generic.go:356] "Generic (PLEG): container finished" podID="8524be03-4385-4b02-a94c-3828707d13d5" containerID="e97cb6c5a581694574945076e0b555b1aa82782f85b756d8e263bae71787f1d9" exitCode=0 Jul 12 19:25:22.130299 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:22.130158 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" event={"ID":"8524be03-4385-4b02-a94c-3828707d13d5","Type":"ContainerDied","Data":"e97cb6c5a581694574945076e0b555b1aa82782f85b756d8e263bae71787f1d9"} Jul 12 19:25:22.130512 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:22.130498 2572 scope.go:117] "RemoveContainer" containerID="e97cb6c5a581694574945076e0b555b1aa82782f85b756d8e263bae71787f1d9" Jul 12 19:25:22.622861 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:22.622830 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_280ee0d4-4dfc-45a3-9dc9-103a196a4797/init-config-reloader/0.log" Jul 12 19:25:22.628599 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:22.628570 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_280ee0d4-4dfc-45a3-9dc9-103a196a4797/alertmanager/0.log" Jul 12 19:25:22.728999 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:22.728971 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_280ee0d4-4dfc-45a3-9dc9-103a196a4797/config-reloader/0.log" Jul 12 19:25:22.929223 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:22.929141 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_280ee0d4-4dfc-45a3-9dc9-103a196a4797/kube-rbac-proxy-web/0.log" Jul 12 19:25:23.129796 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:23.129772 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_280ee0d4-4dfc-45a3-9dc9-103a196a4797/kube-rbac-proxy/0.log" Jul 12 19:25:23.135701 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:23.135675 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5gqk8" event={"ID":"8524be03-4385-4b02-a94c-3828707d13d5","Type":"ContainerStarted","Data":"4baf9191dd53374a01416585cf71339ca8b3cbdf8f9da8b72e4f43ac6d63547f"} Jul 12 19:25:23.329448 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:23.329362 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_280ee0d4-4dfc-45a3-9dc9-103a196a4797/kube-rbac-proxy-metric/0.log" Jul 12 19:25:23.529773 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:23.529744 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_280ee0d4-4dfc-45a3-9dc9-103a196a4797/prom-label-proxy/0.log" Jul 12 19:25:23.732457 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:23.732429 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-t92kk_30f415e8-a1ee-40c8-972b-c88fe2d30530/cluster-monitoring-operator/0.log" Jul 12 19:25:24.530342 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:24.530303 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-58b55fb974-skzwp_74231b74-f63a-4f29-abaa-3f8dd66adb0f/metrics-server/0.log" Jul 12 19:25:26.128672 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:26.128648 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gbtrg_26508366-f163-4cfe-ba39-c05a41514d49/init-textfile/0.log" Jul 12 19:25:26.330643 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:26.330613 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gbtrg_26508366-f163-4cfe-ba39-c05a41514d49/node-exporter/0.log" Jul 12 19:25:26.534700 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:26.534610 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gbtrg_26508366-f163-4cfe-ba39-c05a41514d49/kube-rbac-proxy/0.log" Jul 12 19:25:27.155475 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:27.155425 2572 generic.go:356] "Generic (PLEG): container finished" podID="db7d2e1a-d427-41f6-8273-a1d24a6910ab" containerID="3cf5ba6061f7a6a8fc8ea65e5b10a72450a1b10dff418eccf3f7e0c446267a6b" exitCode=0 Jul 12 19:25:27.155999 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:27.155488 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" event={"ID":"db7d2e1a-d427-41f6-8273-a1d24a6910ab","Type":"ContainerDied","Data":"3cf5ba6061f7a6a8fc8ea65e5b10a72450a1b10dff418eccf3f7e0c446267a6b"} Jul 12 19:25:27.155999 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:27.155947 2572 scope.go:117] "RemoveContainer" containerID="3cf5ba6061f7a6a8fc8ea65e5b10a72450a1b10dff418eccf3f7e0c446267a6b" Jul 12 19:25:27.330365 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:27.330338 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4fb8aebb-8eaf-403b-b5eb-8c9866457731/init-config-reloader/0.log" Jul 12 19:25:27.531642 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:27.531539 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4fb8aebb-8eaf-403b-b5eb-8c9866457731/prometheus/0.log" Jul 12 19:25:27.730032 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:27.730004 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4fb8aebb-8eaf-403b-b5eb-8c9866457731/config-reloader/0.log" Jul 12 19:25:27.932176 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:27.932142 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4fb8aebb-8eaf-403b-b5eb-8c9866457731/thanos-sidecar/0.log" Jul 12 19:25:28.129852 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:28.129824 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4fb8aebb-8eaf-403b-b5eb-8c9866457731/kube-rbac-proxy-web/0.log" Jul 12 19:25:28.160994 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:28.160955 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zjwlz" event={"ID":"db7d2e1a-d427-41f6-8273-a1d24a6910ab","Type":"ContainerStarted","Data":"8f06be1880657d5bf2348211b4fc0133647718952f672cb0fcbc9fa178485644"} Jul 12 19:25:28.330132 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:28.330059 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4fb8aebb-8eaf-403b-b5eb-8c9866457731/kube-rbac-proxy/0.log" Jul 12 19:25:28.529621 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:28.529594 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4fb8aebb-8eaf-403b-b5eb-8c9866457731/kube-rbac-proxy-thanos/0.log" Jul 12 19:25:29.132750 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:29.132724 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-wg8md_ae0a81c9-62bb-4970-8852-f86cf010b72f/prometheus-operator-admission-webhook/0.log" Jul 12 19:25:29.330780 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:29.330748 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55bdcc978c-bvmp2_c451349d-c041-43ff-ac0c-8ebfc14b8594/thanos-query/0.log" Jul 12 19:25:29.530936 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:29.530852 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55bdcc978c-bvmp2_c451349d-c041-43ff-ac0c-8ebfc14b8594/kube-rbac-proxy-web/0.log" Jul 12 19:25:29.729392 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:29.729367 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55bdcc978c-bvmp2_c451349d-c041-43ff-ac0c-8ebfc14b8594/kube-rbac-proxy/0.log" Jul 12 19:25:29.929321 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:29.929265 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55bdcc978c-bvmp2_c451349d-c041-43ff-ac0c-8ebfc14b8594/prom-label-proxy/0.log" Jul 12 19:25:30.129864 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:30.129830 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55bdcc978c-bvmp2_c451349d-c041-43ff-ac0c-8ebfc14b8594/kube-rbac-proxy-rules/0.log" Jul 12 19:25:30.329721 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:30.329641 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55bdcc978c-bvmp2_c451349d-c041-43ff-ac0c-8ebfc14b8594/kube-rbac-proxy-metrics/0.log" Jul 12 19:25:32.178353 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:32.178320 2572 generic.go:356] "Generic (PLEG): container finished" podID="bb491ad0-27ae-489b-855e-dad3e389278e" containerID="e60bf6a3db889eb56d8fc42cd5d28e39621a6f18c2e70e6936ad5c8f80ca6eb6" exitCode=0 Jul 12 19:25:32.178706 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:32.178397 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" event={"ID":"bb491ad0-27ae-489b-855e-dad3e389278e","Type":"ContainerDied","Data":"e60bf6a3db889eb56d8fc42cd5d28e39621a6f18c2e70e6936ad5c8f80ca6eb6"} Jul 12 19:25:32.178706 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:32.178699 2572 scope.go:117] "RemoveContainer" containerID="e60bf6a3db889eb56d8fc42cd5d28e39621a6f18c2e70e6936ad5c8f80ca6eb6" Jul 12 19:25:33.184512 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:33.184475 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-htbxb" event={"ID":"bb491ad0-27ae-489b-855e-dad3e389278e","Type":"ContainerStarted","Data":"851b4b2617cfceafd8d1b1e455ded07d13efc8e27c6bbd4a7825e4a8adf80ec2"} Jul 12 19:25:34.098674 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:34.098645 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:25:34.102988 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:34.102964 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-58b55fb974-skzwp" Jul 12 19:25:55.948007 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:55.947913 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:25:55.968124 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:55.968098 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:25:56.302326 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:25:56.302237 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:09.680615 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:09.680576 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 19:26:09.683655 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:09.681762 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="alertmanager" containerID="cri-o://21a778044063ee8cee9a80efb645c935e086f4725ec958db9b591bce5ec452e7" gracePeriod=120 Jul 12 19:26:09.683655 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:09.682113 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="kube-rbac-proxy" containerID="cri-o://1bfebaa107162d87dcbb478705fb4fe9bb25f24bd4af1f7171a886ef87000f74" gracePeriod=120 Jul 12 19:26:09.683655 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:09.682270 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="kube-rbac-proxy-web" containerID="cri-o://33f0a3d724bdf19f6895aefae648b3781a1986aeb032985275947e29f6e474ac" gracePeriod=120 Jul 12 19:26:09.683655 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:09.682279 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="prom-label-proxy" containerID="cri-o://fe788f008be79034da12bf4ab5843aec0b7500cffaf3dfcb6cb1e13a40b4b0ba" gracePeriod=120 Jul 12 19:26:09.683655 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:09.682358 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="config-reloader" containerID="cri-o://3b1f1970d00e24626045fded1c2f699f7a5b484f05b2e0b28d6e2834fa85c0d8" gracePeriod=120 Jul 12 19:26:09.683655 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:09.682436 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="kube-rbac-proxy-metric" containerID="cri-o://16807a2de7b0aeb5be309bc3519d40869e3951f0c3a6b9f54182bb1fb87189c9" gracePeriod=120 Jul 12 19:26:10.341429 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:10.341393 2572 generic.go:356] "Generic (PLEG): container finished" podID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerID="fe788f008be79034da12bf4ab5843aec0b7500cffaf3dfcb6cb1e13a40b4b0ba" exitCode=0 Jul 12 19:26:10.341429 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:10.341418 2572 generic.go:356] "Generic (PLEG): container finished" podID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerID="1bfebaa107162d87dcbb478705fb4fe9bb25f24bd4af1f7171a886ef87000f74" exitCode=0 Jul 12 19:26:10.341429 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:10.341427 2572 generic.go:356] "Generic (PLEG): container finished" podID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerID="3b1f1970d00e24626045fded1c2f699f7a5b484f05b2e0b28d6e2834fa85c0d8" exitCode=0 Jul 12 19:26:10.341429 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:10.341434 2572 generic.go:356] "Generic (PLEG): container finished" podID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerID="21a778044063ee8cee9a80efb645c935e086f4725ec958db9b591bce5ec452e7" exitCode=0 Jul 12 19:26:10.341690 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:10.341460 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerDied","Data":"fe788f008be79034da12bf4ab5843aec0b7500cffaf3dfcb6cb1e13a40b4b0ba"} Jul 12 19:26:10.341690 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:10.341520 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerDied","Data":"1bfebaa107162d87dcbb478705fb4fe9bb25f24bd4af1f7171a886ef87000f74"} Jul 12 19:26:10.341690 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:10.341545 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerDied","Data":"3b1f1970d00e24626045fded1c2f699f7a5b484f05b2e0b28d6e2834fa85c0d8"} Jul 12 19:26:10.341690 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:10.341569 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerDied","Data":"21a778044063ee8cee9a80efb645c935e086f4725ec958db9b591bce5ec452e7"} Jul 12 19:26:11.350658 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.350626 2572 generic.go:356] "Generic (PLEG): container finished" podID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerID="16807a2de7b0aeb5be309bc3519d40869e3951f0c3a6b9f54182bb1fb87189c9" exitCode=0 Jul 12 19:26:11.350658 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.350658 2572 generic.go:356] "Generic (PLEG): container finished" podID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerID="33f0a3d724bdf19f6895aefae648b3781a1986aeb032985275947e29f6e474ac" exitCode=0 Jul 12 19:26:11.351038 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.350705 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerDied","Data":"16807a2de7b0aeb5be309bc3519d40869e3951f0c3a6b9f54182bb1fb87189c9"} Jul 12 19:26:11.351038 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.350786 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerDied","Data":"33f0a3d724bdf19f6895aefae648b3781a1986aeb032985275947e29f6e474ac"} Jul 12 19:26:11.432648 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.432623 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:11.578315 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.578196 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy\") pod \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " Jul 12 19:26:11.578315 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.578232 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/280ee0d4-4dfc-45a3-9dc9-103a196a4797-alertmanager-trusted-ca-bundle\") pod \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " Jul 12 19:26:11.578315 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.578251 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy-metric\") pod \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " Jul 12 19:26:11.578315 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.578276 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-web-config\") pod \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " Jul 12 19:26:11.578661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.578391 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/280ee0d4-4dfc-45a3-9dc9-103a196a4797-config-out\") pod \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " Jul 12 19:26:11.578661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.578456 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/280ee0d4-4dfc-45a3-9dc9-103a196a4797-tls-assets\") pod \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " Jul 12 19:26:11.578661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.578497 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/280ee0d4-4dfc-45a3-9dc9-103a196a4797-alertmanager-main-db\") pod \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " Jul 12 19:26:11.578661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.578560 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/280ee0d4-4dfc-45a3-9dc9-103a196a4797-metrics-client-ca\") pod \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " Jul 12 19:26:11.578661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.578590 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xjj5\" (UniqueName: \"kubernetes.io/projected/280ee0d4-4dfc-45a3-9dc9-103a196a4797-kube-api-access-6xjj5\") pod \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " Jul 12 19:26:11.578661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.578626 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-main-tls\") pod \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " Jul 12 19:26:11.578661 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.578652 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-config-volume\") pod \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " Jul 12 19:26:11.578996 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.578695 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy-web\") pod \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " Jul 12 19:26:11.578996 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.578731 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-cluster-tls-config\") pod \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\" (UID: \"280ee0d4-4dfc-45a3-9dc9-103a196a4797\") " Jul 12 19:26:11.578996 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.578734 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/280ee0d4-4dfc-45a3-9dc9-103a196a4797-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "280ee0d4-4dfc-45a3-9dc9-103a196a4797" (UID: "280ee0d4-4dfc-45a3-9dc9-103a196a4797"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:26:11.578996 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.578783 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280ee0d4-4dfc-45a3-9dc9-103a196a4797-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "280ee0d4-4dfc-45a3-9dc9-103a196a4797" (UID: "280ee0d4-4dfc-45a3-9dc9-103a196a4797"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:26:11.579210 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.579002 2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/280ee0d4-4dfc-45a3-9dc9-103a196a4797-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:11.579210 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.579020 2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/280ee0d4-4dfc-45a3-9dc9-103a196a4797-alertmanager-main-db\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:11.579501 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.579391 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/280ee0d4-4dfc-45a3-9dc9-103a196a4797-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "280ee0d4-4dfc-45a3-9dc9-103a196a4797" (UID: "280ee0d4-4dfc-45a3-9dc9-103a196a4797"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:26:11.581404 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.581374 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "280ee0d4-4dfc-45a3-9dc9-103a196a4797" (UID: "280ee0d4-4dfc-45a3-9dc9-103a196a4797"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:11.581532 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.581517 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-config-volume" (OuterVolumeSpecName: "config-volume") pod "280ee0d4-4dfc-45a3-9dc9-103a196a4797" (UID: "280ee0d4-4dfc-45a3-9dc9-103a196a4797"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:11.581781 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.581733 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "280ee0d4-4dfc-45a3-9dc9-103a196a4797" (UID: "280ee0d4-4dfc-45a3-9dc9-103a196a4797"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:11.582119 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.582094 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "280ee0d4-4dfc-45a3-9dc9-103a196a4797" (UID: "280ee0d4-4dfc-45a3-9dc9-103a196a4797"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:11.582209 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.582119 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/280ee0d4-4dfc-45a3-9dc9-103a196a4797-kube-api-access-6xjj5" (OuterVolumeSpecName: "kube-api-access-6xjj5") pod "280ee0d4-4dfc-45a3-9dc9-103a196a4797" (UID: "280ee0d4-4dfc-45a3-9dc9-103a196a4797"). InnerVolumeSpecName "kube-api-access-6xjj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:26:11.582445 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.582427 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/280ee0d4-4dfc-45a3-9dc9-103a196a4797-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "280ee0d4-4dfc-45a3-9dc9-103a196a4797" (UID: "280ee0d4-4dfc-45a3-9dc9-103a196a4797"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:26:11.583449 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.583431 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280ee0d4-4dfc-45a3-9dc9-103a196a4797-config-out" (OuterVolumeSpecName: "config-out") pod "280ee0d4-4dfc-45a3-9dc9-103a196a4797" (UID: "280ee0d4-4dfc-45a3-9dc9-103a196a4797"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:26:11.583809 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.583787 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "280ee0d4-4dfc-45a3-9dc9-103a196a4797" (UID: "280ee0d4-4dfc-45a3-9dc9-103a196a4797"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:11.586842 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.586816 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "280ee0d4-4dfc-45a3-9dc9-103a196a4797" (UID: "280ee0d4-4dfc-45a3-9dc9-103a196a4797"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:11.593552 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.593531 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-web-config" (OuterVolumeSpecName: "web-config") pod "280ee0d4-4dfc-45a3-9dc9-103a196a4797" (UID: "280ee0d4-4dfc-45a3-9dc9-103a196a4797"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:11.679487 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.679449 2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/280ee0d4-4dfc-45a3-9dc9-103a196a4797-config-out\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:11.679487 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.679473 2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/280ee0d4-4dfc-45a3-9dc9-103a196a4797-tls-assets\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:11.679487 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.679482 2572 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/280ee0d4-4dfc-45a3-9dc9-103a196a4797-metrics-client-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:11.679487 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.679490 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xjj5\" (UniqueName: \"kubernetes.io/projected/280ee0d4-4dfc-45a3-9dc9-103a196a4797-kube-api-access-6xjj5\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:11.679487 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.679499 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-main-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:11.679885 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.679507 2572 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-config-volume\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:11.679885 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.679516 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:11.679885 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.679524 2572 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-cluster-tls-config\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:11.679885 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.679532 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:11.679885 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.679540 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:11.679885 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:11.679549 2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/280ee0d4-4dfc-45a3-9dc9-103a196a4797-web-config\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:12.357394 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.357361 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"280ee0d4-4dfc-45a3-9dc9-103a196a4797","Type":"ContainerDied","Data":"1e1f2d93dec46556e4183b91da875bb0cdf0e79d07a9cbfd8ea071cf02ec66fd"} Jul 12 19:26:12.357824 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.357416 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.357824 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.357476 2572 scope.go:117] "RemoveContainer" containerID="fe788f008be79034da12bf4ab5843aec0b7500cffaf3dfcb6cb1e13a40b4b0ba" Jul 12 19:26:12.365848 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.365827 2572 scope.go:117] "RemoveContainer" containerID="16807a2de7b0aeb5be309bc3519d40869e3951f0c3a6b9f54182bb1fb87189c9" Jul 12 19:26:12.373172 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.373155 2572 scope.go:117] "RemoveContainer" containerID="1bfebaa107162d87dcbb478705fb4fe9bb25f24bd4af1f7171a886ef87000f74" Jul 12 19:26:12.380690 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.380659 2572 scope.go:117] "RemoveContainer" containerID="33f0a3d724bdf19f6895aefae648b3781a1986aeb032985275947e29f6e474ac" Jul 12 19:26:12.381671 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.381621 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 19:26:12.388011 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.387991 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 19:26:12.388233 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.388216 2572 scope.go:117] "RemoveContainer" containerID="3b1f1970d00e24626045fded1c2f699f7a5b484f05b2e0b28d6e2834fa85c0d8" Jul 12 19:26:12.396314 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.396271 2572 scope.go:117] "RemoveContainer" containerID="21a778044063ee8cee9a80efb645c935e086f4725ec958db9b591bce5ec452e7" Jul 12 19:26:12.403170 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.403151 2572 scope.go:117] "RemoveContainer" containerID="1393ff7b2662c98cb03e05bd16d4c50c0417e47483770162e754493d77c1cc38" Jul 12 19:26:12.415032 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415010 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 19:26:12.415358 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415346 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="kube-rbac-proxy" Jul 12 19:26:12.415407 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415361 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="kube-rbac-proxy" Jul 12 19:26:12.415407 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415374 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="init-config-reloader" Jul 12 19:26:12.415407 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415383 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="init-config-reloader" Jul 12 19:26:12.415407 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415391 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="kube-rbac-proxy-web" Jul 12 19:26:12.415407 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415397 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="kube-rbac-proxy-web" Jul 12 19:26:12.415407 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415404 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="alertmanager" Jul 12 19:26:12.415407 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415409 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="alertmanager" Jul 12 19:26:12.415602 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415414 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="kube-rbac-proxy-metric" Jul 12 19:26:12.415602 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415420 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="kube-rbac-proxy-metric" Jul 12 19:26:12.415602 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415426 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="prom-label-proxy" Jul 12 19:26:12.415602 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415431 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="prom-label-proxy" Jul 12 19:26:12.415602 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415445 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="config-reloader" Jul 12 19:26:12.415602 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415455 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="config-reloader" Jul 12 19:26:12.415602 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415507 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="alertmanager" Jul 12 19:26:12.415602 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415515 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="config-reloader" Jul 12 19:26:12.415602 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415523 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="kube-rbac-proxy-metric" Jul 12 19:26:12.415602 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415533 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="kube-rbac-proxy-web" Jul 12 19:26:12.415602 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415541 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="kube-rbac-proxy" Jul 12 19:26:12.415602 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.415546 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" containerName="prom-label-proxy" Jul 12 19:26:12.418987 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.418973 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.421389 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.421369 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 12 19:26:12.421558 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.421541 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 12 19:26:12.421886 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.421868 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 12 19:26:12.421965 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.421898 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jngln\"" Jul 12 19:26:12.421965 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.421898 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 12 19:26:12.422062 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.421980 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 12 19:26:12.422062 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.421868 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 12 19:26:12.422268 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.422252 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 12 19:26:12.422607 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.422591 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 12 19:26:12.427256 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.427239 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 12 19:26:12.434475 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.434452 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 19:26:12.587749 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.587713 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.587930 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.587759 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-config-volume\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.587930 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.587779 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqccc\" (UniqueName: \"kubernetes.io/projected/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-kube-api-access-wqccc\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.587930 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.587880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-web-config\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.587930 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.587913 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.588120 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.587938 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.588120 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.588003 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.588120 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.588083 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.588319 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.588125 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.588319 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.588149 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-config-out\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.588319 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.588173 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.588319 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.588212 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.588319 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.588277 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.689399 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.689363 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-config-volume\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.689399 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.689401 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqccc\" (UniqueName: \"kubernetes.io/projected/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-kube-api-access-wqccc\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.689668 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.689431 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-web-config\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.689668 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.689449 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.689668 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.689467 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.689668 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.689484 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.689668 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.689512 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.689668 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.689577 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.689668 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.689600 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-config-out\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.689995 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.689693 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.689995 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.689731 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.689995 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.689774 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.689995 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.689853 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.689995 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.689928 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.690617 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.690592 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.690812 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.690654 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.693187 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.693151 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.693322 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.693241 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.693390 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.693365 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-config-volume\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.693503 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.693476 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.693714 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.693688 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.693808 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.693688 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.693962 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.693943 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-web-config\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.694068 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.694053 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.694394 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.694377 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-config-out\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.696899 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.696877 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqccc\" (UniqueName: \"kubernetes.io/projected/bed0b78a-3dbc-4d82-9035-0c8ccbc43e54-kube-api-access-wqccc\") pod \"alertmanager-main-0\" (UID: \"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.728933 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.728912 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:26:12.867233 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:12.867205 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 19:26:12.869373 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:26:12.869350 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed0b78a_3dbc_4d82_9035_0c8ccbc43e54.slice/crio-452d62fdeb138f109f5626b5a44433dedbdaec4e8982dfbb45e447280d92acae WatchSource:0}: Error finding container 452d62fdeb138f109f5626b5a44433dedbdaec4e8982dfbb45e447280d92acae: Status 404 returned error can't find the container with id 452d62fdeb138f109f5626b5a44433dedbdaec4e8982dfbb45e447280d92acae Jul 12 19:26:13.010863 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:13.010831 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="280ee0d4-4dfc-45a3-9dc9-103a196a4797" path="/var/lib/kubelet/pods/280ee0d4-4dfc-45a3-9dc9-103a196a4797/volumes" Jul 12 19:26:13.363542 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:13.363457 2572 generic.go:356] "Generic (PLEG): container finished" podID="bed0b78a-3dbc-4d82-9035-0c8ccbc43e54" containerID="b2e840071417d38dd33963c8ce04fb603e67383f756032ef5af2263527a42c1d" exitCode=0 Jul 12 19:26:13.363542 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:13.363501 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54","Type":"ContainerDied","Data":"b2e840071417d38dd33963c8ce04fb603e67383f756032ef5af2263527a42c1d"} Jul 12 19:26:13.363917 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:13.363566 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54","Type":"ContainerStarted","Data":"452d62fdeb138f109f5626b5a44433dedbdaec4e8982dfbb45e447280d92acae"} Jul 12 19:26:14.004130 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.004051 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 12 19:26:14.004370 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.004346 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="prometheus" containerID="cri-o://6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf" gracePeriod=600 Jul 12 19:26:14.004432 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.004391 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="kube-rbac-proxy-web" containerID="cri-o://2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce" gracePeriod=600 Jul 12 19:26:14.004432 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.004392 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269" gracePeriod=600 Jul 12 19:26:14.004532 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.004427 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="kube-rbac-proxy" containerID="cri-o://fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b" gracePeriod=600 Jul 12 19:26:14.004532 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.004456 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="thanos-sidecar" containerID="cri-o://08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa" gracePeriod=600 Jul 12 19:26:14.004532 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.004468 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="config-reloader" containerID="cri-o://8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce" gracePeriod=600 Jul 12 19:26:14.239515 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.239490 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.369917 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.369840 2572 generic.go:356] "Generic (PLEG): container finished" podID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerID="6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269" exitCode=0 Jul 12 19:26:14.369917 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.369861 2572 generic.go:356] "Generic (PLEG): container finished" podID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerID="fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b" exitCode=0 Jul 12 19:26:14.369917 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.369867 2572 generic.go:356] "Generic (PLEG): container finished" podID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerID="2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce" exitCode=0 Jul 12 19:26:14.369917 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.369872 2572 generic.go:356] "Generic (PLEG): container finished" podID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerID="08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa" exitCode=0 Jul 12 19:26:14.369917 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.369878 2572 generic.go:356] "Generic (PLEG): container finished" podID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerID="8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce" exitCode=0 Jul 12 19:26:14.369917 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.369883 2572 generic.go:356] "Generic (PLEG): container finished" podID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerID="6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf" exitCode=0 Jul 12 19:26:14.370599 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.369925 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.370599 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.369929 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fb8aebb-8eaf-403b-b5eb-8c9866457731","Type":"ContainerDied","Data":"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269"} Jul 12 19:26:14.370599 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.370016 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fb8aebb-8eaf-403b-b5eb-8c9866457731","Type":"ContainerDied","Data":"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b"} Jul 12 19:26:14.370599 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.370064 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fb8aebb-8eaf-403b-b5eb-8c9866457731","Type":"ContainerDied","Data":"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce"} Jul 12 19:26:14.370599 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.370102 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fb8aebb-8eaf-403b-b5eb-8c9866457731","Type":"ContainerDied","Data":"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa"} Jul 12 19:26:14.370599 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.370103 2572 scope.go:117] "RemoveContainer" containerID="6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269" Jul 12 19:26:14.370599 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.370145 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fb8aebb-8eaf-403b-b5eb-8c9866457731","Type":"ContainerDied","Data":"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce"} Jul 12 19:26:14.370599 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.370184 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fb8aebb-8eaf-403b-b5eb-8c9866457731","Type":"ContainerDied","Data":"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf"} Jul 12 19:26:14.370599 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.370222 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fb8aebb-8eaf-403b-b5eb-8c9866457731","Type":"ContainerDied","Data":"107b58aea784e242bbe7a4c8612833e24e4afcba5099a16405b4f4f8920df6ec"} Jul 12 19:26:14.373404 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.373379 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54","Type":"ContainerStarted","Data":"b8ad5907008b9ebdebe51ec4518d4406262320f2c44bf9a72bfdfdb2183cb017"} Jul 12 19:26:14.373520 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.373449 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54","Type":"ContainerStarted","Data":"ef9a4bb70694264a6ec804923e2dd9c1edb85bc464b6c2724c5bf3e4289545b0"} Jul 12 19:26:14.373520 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.373492 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54","Type":"ContainerStarted","Data":"3cdfdb2a3aea53f09fa697a4648834f7627addb2d8f8c3fb6c619ba6f9f9ad9a"} Jul 12 19:26:14.373694 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.373531 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54","Type":"ContainerStarted","Data":"30f35f38f7e19784d8368eeaf303892b384b5b89e173d35a3931850c70408b57"} Jul 12 19:26:14.373694 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.373578 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54","Type":"ContainerStarted","Data":"fc97704cd2ca11004dd88e675a4f65f4d4badccbf8ebbec94b3b4f560a643966"} Jul 12 19:26:14.373694 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.373618 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bed0b78a-3dbc-4d82-9035-0c8ccbc43e54","Type":"ContainerStarted","Data":"6a369c3292901f55e5e90a895b0fae63d5d31bdbbedca6df3f851e250a1898cb"} Jul 12 19:26:14.378178 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.378163 2572 scope.go:117] "RemoveContainer" containerID="fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b" Jul 12 19:26:14.385133 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.385115 2572 scope.go:117] "RemoveContainer" containerID="2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce" Jul 12 19:26:14.391802 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.391786 2572 scope.go:117] "RemoveContainer" containerID="08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa" Jul 12 19:26:14.399070 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.399046 2572 scope.go:117] "RemoveContainer" containerID="8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce" Jul 12 19:26:14.400907 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.400868 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.381512608 podStartE2EDuration="2.400855144s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.342536ms" isStatefulPod=false podCreationTimestamp="2026-07-12 19:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:26:14.399097368 +0000 UTC m=+373.933085544" watchObservedRunningTime="2026-07-12 19:26:14.400855144 +0000 UTC m=+373.934843320" Jul 12 19:26:14.405605 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.405579 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-metrics-client-certs\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.405704 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.405631 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl7gh\" (UniqueName: \"kubernetes.io/projected/4fb8aebb-8eaf-403b-b5eb-8c9866457731-kube-api-access-hl7gh\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.405704 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.405662 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-metrics-client-ca\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.405704 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.405692 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-db\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.405846 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.405723 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-thanos-prometheus-http-client-file\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.405846 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.405756 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-serving-certs-ca-bundle\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.405846 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.405788 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-1\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.405846 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.405816 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-trusted-ca-bundle\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.406048 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.405854 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-web-config\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.406048 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.405909 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fb8aebb-8eaf-403b-b5eb-8c9866457731-tls-assets\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.406048 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.405961 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.406048 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.405997 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-2\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.406048 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.406028 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-grpc-tls\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.406277 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.406069 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-config\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.406277 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.406111 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.406277 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.406115 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:26:14.406277 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.406146 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-tls\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.406277 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.406200 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-kube-rbac-proxy\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.406277 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.406231 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-kubelet-serving-ca-bundle\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.406277 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.406257 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-0\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.406707 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.406354 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fb8aebb-8eaf-403b-b5eb-8c9866457731-config-out\") pod \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\" (UID: \"4fb8aebb-8eaf-403b-b5eb-8c9866457731\") " Jul 12 19:26:14.406707 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.406676 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-metrics-client-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.407392 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.407349 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:26:14.407605 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.407423 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:26:14.408606 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.407953 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:26:14.408606 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.407967 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:26:14.408606 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.408056 2572 scope.go:117] "RemoveContainer" containerID="6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf" Jul 12 19:26:14.410097 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.410070 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:26:14.410417 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.410393 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:26:14.410503 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.410470 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:14.411930 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.411901 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:26:14.412034 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.411931 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fb8aebb-8eaf-403b-b5eb-8c9866457731-config-out" (OuterVolumeSpecName: "config-out") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:26:14.412489 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.412466 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:14.412706 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.412679 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:14.412782 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.412718 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:14.413105 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.413078 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fb8aebb-8eaf-403b-b5eb-8c9866457731-kube-api-access-hl7gh" (OuterVolumeSpecName: "kube-api-access-hl7gh") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "kube-api-access-hl7gh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:26:14.413192 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.413165 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:14.413549 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.413449 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fb8aebb-8eaf-403b-b5eb-8c9866457731-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:26:14.413805 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.413774 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:14.414002 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.413966 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:14.415536 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.415512 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-config" (OuterVolumeSpecName: "config") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:14.421725 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.421702 2572 scope.go:117] "RemoveContainer" containerID="97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a" Jul 12 19:26:14.427455 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.427429 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-web-config" (OuterVolumeSpecName: "web-config") pod "4fb8aebb-8eaf-403b-b5eb-8c9866457731" (UID: "4fb8aebb-8eaf-403b-b5eb-8c9866457731"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:26:14.429161 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.429145 2572 scope.go:117] "RemoveContainer" containerID="6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269" Jul 12 19:26:14.429468 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:26:14.429447 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269\": container with ID starting with 6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269 not found: ID does not exist" containerID="6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269" Jul 12 19:26:14.429550 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.429481 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269"} err="failed to get container status \"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269\": rpc error: code = NotFound desc = could not find container \"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269\": container with ID starting with 6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269 not found: ID does not exist" Jul 12 19:26:14.429550 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.429525 2572 scope.go:117] "RemoveContainer" containerID="fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b" Jul 12 19:26:14.429804 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:26:14.429785 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b\": container with ID starting with fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b not found: ID does not exist" containerID="fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b" Jul 12 19:26:14.429888 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.429808 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b"} err="failed to get container status \"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b\": rpc error: code = NotFound desc = could not find container \"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b\": container with ID starting with fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b not found: ID does not exist" Jul 12 19:26:14.429888 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.429822 2572 scope.go:117] "RemoveContainer" containerID="2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce" Jul 12 19:26:14.430121 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:26:14.430086 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce\": container with ID starting with 2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce not found: ID does not exist" containerID="2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce" Jul 12 19:26:14.430171 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.430127 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce"} err="failed to get container status \"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce\": rpc error: code = NotFound desc = could not find container \"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce\": container with ID starting with 2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce not found: ID does not exist" Jul 12 19:26:14.430171 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.430143 2572 scope.go:117] "RemoveContainer" containerID="08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa" Jul 12 19:26:14.430505 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:26:14.430487 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa\": container with ID starting with 08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa not found: ID does not exist" containerID="08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa" Jul 12 19:26:14.430604 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.430512 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa"} err="failed to get container status \"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa\": rpc error: code = NotFound desc = could not find container \"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa\": container with ID starting with 08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa not found: ID does not exist" Jul 12 19:26:14.430604 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.430533 2572 scope.go:117] "RemoveContainer" containerID="8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce" Jul 12 19:26:14.430784 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:26:14.430767 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce\": container with ID starting with 8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce not found: ID does not exist" containerID="8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce" Jul 12 19:26:14.430834 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.430789 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce"} err="failed to get container status \"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce\": rpc error: code = NotFound desc = could not find container \"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce\": container with ID starting with 8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce not found: ID does not exist" Jul 12 19:26:14.430834 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.430805 2572 scope.go:117] "RemoveContainer" containerID="6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf" Jul 12 19:26:14.431126 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:26:14.431109 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf\": container with ID starting with 6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf not found: ID does not exist" containerID="6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf" Jul 12 19:26:14.431185 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.431129 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf"} err="failed to get container status \"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf\": rpc error: code = NotFound desc = could not find container \"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf\": container with ID starting with 6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf not found: ID does not exist" Jul 12 19:26:14.431185 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.431141 2572 scope.go:117] "RemoveContainer" containerID="97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a" Jul 12 19:26:14.431415 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:26:14.431399 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a\": container with ID starting with 97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a not found: ID does not exist" containerID="97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a" Jul 12 19:26:14.431485 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.431419 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a"} err="failed to get container status \"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a\": rpc error: code = NotFound desc = could not find container \"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a\": container with ID starting with 97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a not found: ID does not exist" Jul 12 19:26:14.431485 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.431432 2572 scope.go:117] "RemoveContainer" containerID="6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269" Jul 12 19:26:14.431653 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.431635 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269"} err="failed to get container status \"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269\": rpc error: code = NotFound desc = could not find container \"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269\": container with ID starting with 6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269 not found: ID does not exist" Jul 12 19:26:14.431711 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.431655 2572 scope.go:117] "RemoveContainer" containerID="fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b" Jul 12 19:26:14.431901 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.431883 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b"} err="failed to get container status \"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b\": rpc error: code = NotFound desc = could not find container \"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b\": container with ID starting with fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b not found: ID does not exist" Jul 12 19:26:14.431901 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.431904 2572 scope.go:117] "RemoveContainer" containerID="2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce" Jul 12 19:26:14.432119 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.432099 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce"} err="failed to get container status \"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce\": rpc error: code = NotFound desc = could not find container \"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce\": container with ID starting with 2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce not found: ID does not exist" Jul 12 19:26:14.432164 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.432121 2572 scope.go:117] "RemoveContainer" containerID="08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa" Jul 12 19:26:14.432388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.432369 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa"} err="failed to get container status \"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa\": rpc error: code = NotFound desc = could not find container \"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa\": container with ID starting with 08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa not found: ID does not exist" Jul 12 19:26:14.432388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.432387 2572 scope.go:117] "RemoveContainer" containerID="8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce" Jul 12 19:26:14.432621 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.432605 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce"} err="failed to get container status \"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce\": rpc error: code = NotFound desc = could not find container \"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce\": container with ID starting with 8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce not found: ID does not exist" Jul 12 19:26:14.432690 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.432622 2572 scope.go:117] "RemoveContainer" containerID="6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf" Jul 12 19:26:14.432858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.432839 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf"} err="failed to get container status \"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf\": rpc error: code = NotFound desc = could not find container \"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf\": container with ID starting with 6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf not found: ID does not exist" Jul 12 19:26:14.432918 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.432859 2572 scope.go:117] "RemoveContainer" containerID="97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a" Jul 12 19:26:14.433124 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.433106 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a"} err="failed to get container status \"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a\": rpc error: code = NotFound desc = could not find container \"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a\": container with ID starting with 97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a not found: ID does not exist" Jul 12 19:26:14.433124 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.433123 2572 scope.go:117] "RemoveContainer" containerID="6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269" Jul 12 19:26:14.433385 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.433368 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269"} err="failed to get container status \"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269\": rpc error: code = NotFound desc = could not find container \"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269\": container with ID starting with 6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269 not found: ID does not exist" Jul 12 19:26:14.433448 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.433387 2572 scope.go:117] "RemoveContainer" containerID="fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b" Jul 12 19:26:14.433603 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.433585 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b"} err="failed to get container status \"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b\": rpc error: code = NotFound desc = could not find container \"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b\": container with ID starting with fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b not found: ID does not exist" Jul 12 19:26:14.433656 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.433604 2572 scope.go:117] "RemoveContainer" containerID="2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce" Jul 12 19:26:14.433795 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.433777 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce"} err="failed to get container status \"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce\": rpc error: code = NotFound desc = could not find container \"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce\": container with ID starting with 2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce not found: ID does not exist" Jul 12 19:26:14.433841 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.433797 2572 scope.go:117] "RemoveContainer" containerID="08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa" Jul 12 19:26:14.434001 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.433981 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa"} err="failed to get container status \"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa\": rpc error: code = NotFound desc = could not find container \"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa\": container with ID starting with 08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa not found: ID does not exist" Jul 12 19:26:14.434001 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.434000 2572 scope.go:117] "RemoveContainer" containerID="8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce" Jul 12 19:26:14.434243 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.434226 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce"} err="failed to get container status \"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce\": rpc error: code = NotFound desc = could not find container \"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce\": container with ID starting with 8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce not found: ID does not exist" Jul 12 19:26:14.434364 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.434243 2572 scope.go:117] "RemoveContainer" containerID="6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf" Jul 12 19:26:14.434518 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.434495 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf"} err="failed to get container status \"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf\": rpc error: code = NotFound desc = could not find container \"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf\": container with ID starting with 6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf not found: ID does not exist" Jul 12 19:26:14.434518 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.434514 2572 scope.go:117] "RemoveContainer" containerID="97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a" Jul 12 19:26:14.434742 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.434724 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a"} err="failed to get container status \"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a\": rpc error: code = NotFound desc = could not find container \"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a\": container with ID starting with 97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a not found: ID does not exist" Jul 12 19:26:14.434797 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.434743 2572 scope.go:117] "RemoveContainer" containerID="6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269" Jul 12 19:26:14.434967 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.434946 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269"} err="failed to get container status \"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269\": rpc error: code = NotFound desc = could not find container \"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269\": container with ID starting with 6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269 not found: ID does not exist" Jul 12 19:26:14.435017 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.434968 2572 scope.go:117] "RemoveContainer" containerID="fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b" Jul 12 19:26:14.435182 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.435166 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b"} err="failed to get container status \"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b\": rpc error: code = NotFound desc = could not find container \"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b\": container with ID starting with fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b not found: ID does not exist" Jul 12 19:26:14.435182 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.435184 2572 scope.go:117] "RemoveContainer" containerID="2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce" Jul 12 19:26:14.435412 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.435394 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce"} err="failed to get container status \"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce\": rpc error: code = NotFound desc = could not find container \"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce\": container with ID starting with 2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce not found: ID does not exist" Jul 12 19:26:14.435459 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.435414 2572 scope.go:117] "RemoveContainer" containerID="08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa" Jul 12 19:26:14.435668 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.435650 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa"} err="failed to get container status \"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa\": rpc error: code = NotFound desc = could not find container \"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa\": container with ID starting with 08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa not found: ID does not exist" Jul 12 19:26:14.435668 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.435667 2572 scope.go:117] "RemoveContainer" containerID="8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce" Jul 12 19:26:14.435894 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.435875 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce"} err="failed to get container status \"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce\": rpc error: code = NotFound desc = could not find container \"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce\": container with ID starting with 8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce not found: ID does not exist" Jul 12 19:26:14.435943 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.435895 2572 scope.go:117] "RemoveContainer" containerID="6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf" Jul 12 19:26:14.436100 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.436083 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf"} err="failed to get container status \"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf\": rpc error: code = NotFound desc = could not find container \"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf\": container with ID starting with 6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf not found: ID does not exist" Jul 12 19:26:14.436161 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.436102 2572 scope.go:117] "RemoveContainer" containerID="97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a" Jul 12 19:26:14.436324 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.436303 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a"} err="failed to get container status \"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a\": rpc error: code = NotFound desc = could not find container \"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a\": container with ID starting with 97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a not found: ID does not exist" Jul 12 19:26:14.436399 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.436325 2572 scope.go:117] "RemoveContainer" containerID="6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269" Jul 12 19:26:14.436538 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.436523 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269"} err="failed to get container status \"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269\": rpc error: code = NotFound desc = could not find container \"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269\": container with ID starting with 6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269 not found: ID does not exist" Jul 12 19:26:14.436585 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.436539 2572 scope.go:117] "RemoveContainer" containerID="fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b" Jul 12 19:26:14.436765 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.436748 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b"} err="failed to get container status \"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b\": rpc error: code = NotFound desc = could not find container \"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b\": container with ID starting with fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b not found: ID does not exist" Jul 12 19:26:14.436765 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.436764 2572 scope.go:117] "RemoveContainer" containerID="2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce" Jul 12 19:26:14.437012 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.436985 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce"} err="failed to get container status \"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce\": rpc error: code = NotFound desc = could not find container \"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce\": container with ID starting with 2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce not found: ID does not exist" Jul 12 19:26:14.437073 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.437011 2572 scope.go:117] "RemoveContainer" containerID="08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa" Jul 12 19:26:14.437254 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.437235 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa"} err="failed to get container status \"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa\": rpc error: code = NotFound desc = could not find container \"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa\": container with ID starting with 08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa not found: ID does not exist" Jul 12 19:26:14.437325 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.437255 2572 scope.go:117] "RemoveContainer" containerID="8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce" Jul 12 19:26:14.437524 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.437506 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce"} err="failed to get container status \"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce\": rpc error: code = NotFound desc = could not find container \"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce\": container with ID starting with 8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce not found: ID does not exist" Jul 12 19:26:14.437524 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.437524 2572 scope.go:117] "RemoveContainer" containerID="6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf" Jul 12 19:26:14.437737 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.437719 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf"} err="failed to get container status \"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf\": rpc error: code = NotFound desc = could not find container \"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf\": container with ID starting with 6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf not found: ID does not exist" Jul 12 19:26:14.437815 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.437740 2572 scope.go:117] "RemoveContainer" containerID="97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a" Jul 12 19:26:14.437949 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.437934 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a"} err="failed to get container status \"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a\": rpc error: code = NotFound desc = could not find container \"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a\": container with ID starting with 97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a not found: ID does not exist" Jul 12 19:26:14.438004 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.437949 2572 scope.go:117] "RemoveContainer" containerID="6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269" Jul 12 19:26:14.438196 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.438176 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269"} err="failed to get container status \"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269\": rpc error: code = NotFound desc = could not find container \"6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269\": container with ID starting with 6f0ac49d6fe5b88fac95bf36cc4144d43e2166a63f882c0c3fdf69ed2399c269 not found: ID does not exist" Jul 12 19:26:14.438196 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.438196 2572 scope.go:117] "RemoveContainer" containerID="fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b" Jul 12 19:26:14.438469 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.438446 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b"} err="failed to get container status \"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b\": rpc error: code = NotFound desc = could not find container \"fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b\": container with ID starting with fb7abe13b6d555c7e31cc283df4b41ccec2e759765a809319c2bfabe67e5675b not found: ID does not exist" Jul 12 19:26:14.438546 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.438470 2572 scope.go:117] "RemoveContainer" containerID="2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce" Jul 12 19:26:14.438744 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.438708 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce"} err="failed to get container status \"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce\": rpc error: code = NotFound desc = could not find container \"2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce\": container with ID starting with 2f0f7e6e302c257870f24fc1e2ce0bbe8e8ef86742a626f22245634fb67f53ce not found: ID does not exist" Jul 12 19:26:14.438791 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.438746 2572 scope.go:117] "RemoveContainer" containerID="08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa" Jul 12 19:26:14.439024 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.439004 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa"} err="failed to get container status \"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa\": rpc error: code = NotFound desc = could not find container \"08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa\": container with ID starting with 08326a133550dacf46b77bd3771faef63d481ab3ea44fc2db5c38497bcbf45aa not found: ID does not exist" Jul 12 19:26:14.439067 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.439025 2572 scope.go:117] "RemoveContainer" containerID="8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce" Jul 12 19:26:14.439263 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.439241 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce"} err="failed to get container status \"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce\": rpc error: code = NotFound desc = could not find container \"8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce\": container with ID starting with 8d0726e4208ea787246e73e7616e711bd462970a9f6f65159ca3c59b389686ce not found: ID does not exist" Jul 12 19:26:14.439330 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.439265 2572 scope.go:117] "RemoveContainer" containerID="6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf" Jul 12 19:26:14.439523 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.439501 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf"} err="failed to get container status \"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf\": rpc error: code = NotFound desc = could not find container \"6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf\": container with ID starting with 6da7f8652e3e4bc801e62e0671dce5d820da74ee6a50c0f934ce7a7ec74cf3bf not found: ID does not exist" Jul 12 19:26:14.439523 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.439522 2572 scope.go:117] "RemoveContainer" containerID="97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a" Jul 12 19:26:14.439771 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.439753 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a"} err="failed to get container status \"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a\": rpc error: code = NotFound desc = could not find container \"97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a\": container with ID starting with 97f23b42eed0a3a478d13f3123ad3d3f37994dc4b7580475eae50bbdfd4f011a not found: ID does not exist" Jul 12 19:26:14.507852 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.507822 2572 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-metrics-client-certs\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.507852 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.507854 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl7gh\" (UniqueName: \"kubernetes.io/projected/4fb8aebb-8eaf-403b-b5eb-8c9866457731-kube-api-access-hl7gh\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508039 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.507869 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-db\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508039 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.507886 2572 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508039 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.507904 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508039 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.507919 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508039 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.507935 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508039 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.507950 2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-web-config\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508039 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.507965 2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fb8aebb-8eaf-403b-b5eb-8c9866457731-tls-assets\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508039 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.507976 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508039 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.507985 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508039 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.507993 2572 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-grpc-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508039 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.508001 2572 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-config\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508039 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.508019 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508039 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.508034 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508039 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.508044 2572 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fb8aebb-8eaf-403b-b5eb-8c9866457731-secret-kube-rbac-proxy\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508517 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.508054 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508517 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.508064 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4fb8aebb-8eaf-403b-b5eb-8c9866457731-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.508517 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.508073 2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fb8aebb-8eaf-403b-b5eb-8c9866457731-config-out\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:26:14.693795 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.693764 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 12 19:26:14.701158 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.700162 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 12 19:26:14.709625 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.709601 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:26:14.711925 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.711907 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b658735-f326-4144-a145-c33b84cff253-metrics-certs\") pod \"network-metrics-daemon-5t7x2\" (UID: \"9b658735-f326-4144-a145-c33b84cff253\") " pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:26:14.720573 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720554 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 12 19:26:14.720857 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720845 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="thanos-sidecar" Jul 12 19:26:14.720894 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720859 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="thanos-sidecar" Jul 12 19:26:14.720894 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720874 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="prometheus" Jul 12 19:26:14.720894 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720880 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="prometheus" Jul 12 19:26:14.720894 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720890 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="kube-rbac-proxy-web" Jul 12 19:26:14.721029 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720896 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="kube-rbac-proxy-web" Jul 12 19:26:14.721029 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720902 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="kube-rbac-proxy-thanos" Jul 12 19:26:14.721029 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720907 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="kube-rbac-proxy-thanos" Jul 12 19:26:14.721029 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720915 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="init-config-reloader" Jul 12 19:26:14.721029 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720920 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="init-config-reloader" Jul 12 19:26:14.721029 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720927 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="config-reloader" Jul 12 19:26:14.721029 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720932 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="config-reloader" Jul 12 19:26:14.721029 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720939 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="kube-rbac-proxy" Jul 12 19:26:14.721029 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720944 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="kube-rbac-proxy" Jul 12 19:26:14.721029 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.720994 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="kube-rbac-proxy" Jul 12 19:26:14.721029 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.721003 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="kube-rbac-proxy-web" Jul 12 19:26:14.721029 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.721011 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="thanos-sidecar" Jul 12 19:26:14.721029 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.721017 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="prometheus" Jul 12 19:26:14.721029 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.721023 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="config-reloader" Jul 12 19:26:14.721029 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.721029 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" containerName="kube-rbac-proxy-thanos" Jul 12 19:26:14.724813 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.724798 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.727345 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.727323 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 12 19:26:14.727605 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.727589 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 12 19:26:14.727702 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.727624 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 12 19:26:14.727702 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.727629 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 12 19:26:14.727702 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.727692 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 12 19:26:14.727848 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.727776 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 12 19:26:14.727848 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.727826 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 12 19:26:14.727984 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.727899 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 12 19:26:14.727984 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.727942 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 12 19:26:14.728086 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.728069 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-929hu787rhj08\"" Jul 12 19:26:14.728459 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.728447 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 12 19:26:14.728723 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.728707 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 12 19:26:14.728821 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.728745 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jz6zw\"" Jul 12 19:26:14.728821 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.728748 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 12 19:26:14.730916 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.730900 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 12 19:26:14.733010 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.732989 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 12 19:26:14.741043 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.741022 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 12 19:26:14.810600 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810569 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-web-config\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.810600 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810600 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.810825 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810630 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-config\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.810825 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810648 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.810825 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810665 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.810825 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810680 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xwsm\" (UniqueName: \"kubernetes.io/projected/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-kube-api-access-5xwsm\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.810825 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810696 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.810825 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810713 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.810825 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810750 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.810825 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810786 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.810825 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810804 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.811084 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810839 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.811084 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810856 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.811084 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810887 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.811084 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810910 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.811084 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810928 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.811084 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810946 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.811084 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.810963 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.811084 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.811003 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.811084 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.811039 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-config-out\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.909676 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.909645 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-brd5c\"" Jul 12 19:26:14.912002 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.911983 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-web-config\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912068 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912013 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912068 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912049 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-config\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912137 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912137 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912099 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912137 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912120 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xwsm\" (UniqueName: \"kubernetes.io/projected/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-kube-api-access-5xwsm\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912272 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912144 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912272 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912172 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912502 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912481 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912573 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912527 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912573 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912559 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912693 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912605 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912693 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912632 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912693 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912669 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912949 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912695 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912949 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912721 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912949 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912745 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912949 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912767 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912949 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912916 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.912949 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.912919 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.913396 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.913015 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-config-out\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.913396 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.913333 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.913761 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.913732 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.915824 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.915338 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-web-config\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.915824 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.915457 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.915824 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.915505 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.915824 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.915551 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-config-out\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.915824 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.915590 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.916125 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.915849 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.916125 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.915861 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.916125 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.915984 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.916125 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.915997 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.916608 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.916569 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.916755 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.916705 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.916864 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.916840 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7x2" Jul 12 19:26:14.917334 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.917314 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-config\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.918152 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.918128 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.918335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.918314 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.918537 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.918522 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.919887 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.919867 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:14.920355 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:14.920337 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xwsm\" (UniqueName: \"kubernetes.io/projected/a51a8b4d-cbe3-4dc3-b804-02d029ea7f73-kube-api-access-5xwsm\") pod \"prometheus-k8s-0\" (UID: \"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:15.011755 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:15.011725 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fb8aebb-8eaf-403b-b5eb-8c9866457731" path="/var/lib/kubelet/pods/4fb8aebb-8eaf-403b-b5eb-8c9866457731/volumes" Jul 12 19:26:15.035396 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:15.035366 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:26:15.049894 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:15.049864 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5t7x2"] Jul 12 19:26:15.053142 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:26:15.053110 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b658735_f326_4144_a145_c33b84cff253.slice/crio-adc82050644d931b941b1ab91b9ef0248b701bd4f862d5bc6928104986c5ad9e WatchSource:0}: Error finding container adc82050644d931b941b1ab91b9ef0248b701bd4f862d5bc6928104986c5ad9e: Status 404 returned error can't find the container with id adc82050644d931b941b1ab91b9ef0248b701bd4f862d5bc6928104986c5ad9e Jul 12 19:26:15.055100 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:15.055085 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 19:26:15.177392 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:15.177367 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 12 19:26:15.180300 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:26:15.179076 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51a8b4d_cbe3_4dc3_b804_02d029ea7f73.slice/crio-550a195bcd5c80a34f8e75f277062e3a84bf44b6c92261d5cce1c1f09a9cdba1 WatchSource:0}: Error finding container 550a195bcd5c80a34f8e75f277062e3a84bf44b6c92261d5cce1c1f09a9cdba1: Status 404 returned error can't find the container with id 550a195bcd5c80a34f8e75f277062e3a84bf44b6c92261d5cce1c1f09a9cdba1 Jul 12 19:26:15.379441 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:15.379402 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5t7x2" event={"ID":"9b658735-f326-4144-a145-c33b84cff253","Type":"ContainerStarted","Data":"adc82050644d931b941b1ab91b9ef0248b701bd4f862d5bc6928104986c5ad9e"} Jul 12 19:26:15.380829 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:15.380807 2572 generic.go:356] "Generic (PLEG): container finished" podID="a51a8b4d-cbe3-4dc3-b804-02d029ea7f73" containerID="6e3d11e5bc458b50c55ba09763ee9f6f3f4e1c3fc1bce2465fd83e5b188cc2de" exitCode=0 Jul 12 19:26:15.380915 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:15.380893 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73","Type":"ContainerDied","Data":"6e3d11e5bc458b50c55ba09763ee9f6f3f4e1c3fc1bce2465fd83e5b188cc2de"} Jul 12 19:26:15.380985 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:15.380971 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73","Type":"ContainerStarted","Data":"550a195bcd5c80a34f8e75f277062e3a84bf44b6c92261d5cce1c1f09a9cdba1"} Jul 12 19:26:16.387548 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:16.387509 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5t7x2" event={"ID":"9b658735-f326-4144-a145-c33b84cff253","Type":"ContainerStarted","Data":"e5e32d1bb7d71a9a451846c91b1f21c33d6adebae459868d2bda422384b2d5ae"} Jul 12 19:26:16.388001 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:16.387613 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5t7x2" event={"ID":"9b658735-f326-4144-a145-c33b84cff253","Type":"ContainerStarted","Data":"42592b0813fef3994009643b8d9f4331f0dd239b99164c7c179f30502fbab334"} Jul 12 19:26:16.390914 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:16.390891 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73","Type":"ContainerStarted","Data":"ed4af9b77d522c6195938b0bc4cbd23c88dcc353ed9a8ba894a8d81daf5a9bd4"} Jul 12 19:26:16.390999 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:16.390943 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73","Type":"ContainerStarted","Data":"d7fec1456b1e210efe52d1e5c68c1ec0b5e6d46d10e7f82a258e981dd0d4b1c0"} Jul 12 19:26:16.390999 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:16.390970 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73","Type":"ContainerStarted","Data":"9e830f65c570e3d2668b2b381bc61e0a3e24f44d4fc8b1c4995d00ff0a47b2b0"} Jul 12 19:26:16.390999 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:16.390996 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73","Type":"ContainerStarted","Data":"669d8c321cc1bc85a7ff8df99d512e91003766019bfea7ce5e2dd5884714f55d"} Jul 12 19:26:16.391085 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:16.391021 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73","Type":"ContainerStarted","Data":"9e4b37f0e4f685569d863b5c524fb8113ba833bc7d6a3d1b55c8e50e4c8066e3"} Jul 12 19:26:16.391085 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:16.391048 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a51a8b4d-cbe3-4dc3-b804-02d029ea7f73","Type":"ContainerStarted","Data":"6d24bcf5f60fb6db8e6a24d1e24140643d3d37830b15d283bc671635d6d69f2f"} Jul 12 19:26:16.403304 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:16.403241 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5t7x2" podStartSLOduration=374.4353522 podStartE2EDuration="6m15.403228566s" totalImagesPullingTime="967.876366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:26:16.402340462 +0000 UTC m=+375.936328725" watchObservedRunningTime="2026-07-12 19:26:16.403228566 +0000 UTC m=+375.937216790" Jul 12 19:26:16.430334 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:16.430268 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.412050178 podStartE2EDuration="2.430253219s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.203041ms" isStatefulPod=false podCreationTimestamp="2026-07-12 19:26:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:26:16.427738375 +0000 UTC m=+375.961726574" watchObservedRunningTime="2026-07-12 19:26:16.430253219 +0000 UTC m=+375.964241393" Jul 12 19:26:20.035980 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:26:20.035946 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:27:15.036461 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:27:15.036428 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:27:15.052503 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:27:15.052472 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:27:15.647895 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:27:15.647868 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 12 19:28:50.317210 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:50.317174 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-prmdt"] Jul 12 19:28:50.320542 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:50.320523 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-prmdt" Jul 12 19:28:50.323033 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:50.323000 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qlptx\"" Jul 12 19:28:50.323033 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:50.323029 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 12 19:28:50.324207 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:50.324188 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 12 19:28:50.328326 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:50.328309 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-prmdt"] Jul 12 19:28:50.432450 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:50.432406 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hts5\" (UniqueName: \"kubernetes.io/projected/14602cd7-bb6f-4c3a-9a87-592fc60ba8f3-kube-api-access-2hts5\") pod \"cert-manager-55b4d954d5-prmdt\" (UID: \"14602cd7-bb6f-4c3a-9a87-592fc60ba8f3\") " pod="cert-manager/cert-manager-55b4d954d5-prmdt" Jul 12 19:28:50.432650 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:50.432537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14602cd7-bb6f-4c3a-9a87-592fc60ba8f3-bound-sa-token\") pod \"cert-manager-55b4d954d5-prmdt\" (UID: \"14602cd7-bb6f-4c3a-9a87-592fc60ba8f3\") " pod="cert-manager/cert-manager-55b4d954d5-prmdt" Jul 12 19:28:50.533339 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:50.533270 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hts5\" (UniqueName: \"kubernetes.io/projected/14602cd7-bb6f-4c3a-9a87-592fc60ba8f3-kube-api-access-2hts5\") pod \"cert-manager-55b4d954d5-prmdt\" (UID: \"14602cd7-bb6f-4c3a-9a87-592fc60ba8f3\") " pod="cert-manager/cert-manager-55b4d954d5-prmdt" Jul 12 19:28:50.533511 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:50.533418 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14602cd7-bb6f-4c3a-9a87-592fc60ba8f3-bound-sa-token\") pod \"cert-manager-55b4d954d5-prmdt\" (UID: \"14602cd7-bb6f-4c3a-9a87-592fc60ba8f3\") " pod="cert-manager/cert-manager-55b4d954d5-prmdt" Jul 12 19:28:50.542632 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:50.542598 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14602cd7-bb6f-4c3a-9a87-592fc60ba8f3-bound-sa-token\") pod \"cert-manager-55b4d954d5-prmdt\" (UID: \"14602cd7-bb6f-4c3a-9a87-592fc60ba8f3\") " pod="cert-manager/cert-manager-55b4d954d5-prmdt" Jul 12 19:28:50.542751 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:50.542721 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hts5\" (UniqueName: \"kubernetes.io/projected/14602cd7-bb6f-4c3a-9a87-592fc60ba8f3-kube-api-access-2hts5\") pod \"cert-manager-55b4d954d5-prmdt\" (UID: \"14602cd7-bb6f-4c3a-9a87-592fc60ba8f3\") " pod="cert-manager/cert-manager-55b4d954d5-prmdt" Jul 12 19:28:50.640413 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:50.640388 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-prmdt" Jul 12 19:28:50.767649 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:50.767623 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-prmdt"] Jul 12 19:28:50.770296 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:28:50.770248 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14602cd7_bb6f_4c3a_9a87_592fc60ba8f3.slice/crio-959c7e3f0ab73bd9f7bc1f0d7adf2837b765d29e602e21c178d3cf597be3c5e3 WatchSource:0}: Error finding container 959c7e3f0ab73bd9f7bc1f0d7adf2837b765d29e602e21c178d3cf597be3c5e3: Status 404 returned error can't find the container with id 959c7e3f0ab73bd9f7bc1f0d7adf2837b765d29e602e21c178d3cf597be3c5e3 Jul 12 19:28:51.004177 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:51.004087 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-prmdt" event={"ID":"14602cd7-bb6f-4c3a-9a87-592fc60ba8f3","Type":"ContainerStarted","Data":"959c7e3f0ab73bd9f7bc1f0d7adf2837b765d29e602e21c178d3cf597be3c5e3"} Jul 12 19:28:54.018458 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:54.018376 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-prmdt" event={"ID":"14602cd7-bb6f-4c3a-9a87-592fc60ba8f3","Type":"ContainerStarted","Data":"0a1b856d7436c2fdb537e0e56e8104ae6482487dfe2407770b050f48d25b539f"} Jul 12 19:28:54.033848 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:28:54.033803 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-prmdt" podStartSLOduration=1.117684558 podStartE2EDuration="4.033786529s" totalImagesPullingTime="2.916101971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:28:54.032199645 +0000 UTC m=+533.566187822" watchObservedRunningTime="2026-07-12 19:28:54.033786529 +0000 UTC m=+533.567774704" Jul 12 19:29:13.546060 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.546024 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9"] Jul 12 19:29:13.549479 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.549463 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:13.553484 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.553466 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 12 19:29:13.554603 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.554565 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vs8gx\"" Jul 12 19:29:13.554717 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.554568 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 12 19:29:13.554831 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.554814 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 12 19:29:13.554967 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.554947 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 12 19:29:13.555529 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.555511 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 12 19:29:13.564388 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.564368 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9"] Jul 12 19:29:13.638573 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.638534 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff-manager-config\") pod \"lws-controller-manager-89775f59b-rxzs9\" (UID: \"c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff\") " pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:13.638573 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.638568 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff-metrics-cert\") pod \"lws-controller-manager-89775f59b-rxzs9\" (UID: \"c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff\") " pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:13.638773 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.638588 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff-cert\") pod \"lws-controller-manager-89775f59b-rxzs9\" (UID: \"c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff\") " pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:13.638773 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.638689 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vlg6\" (UniqueName: \"kubernetes.io/projected/c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff-kube-api-access-6vlg6\") pod \"lws-controller-manager-89775f59b-rxzs9\" (UID: \"c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff\") " pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:13.739601 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.739568 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vlg6\" (UniqueName: \"kubernetes.io/projected/c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff-kube-api-access-6vlg6\") pod \"lws-controller-manager-89775f59b-rxzs9\" (UID: \"c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff\") " pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:13.739771 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.739620 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff-manager-config\") pod \"lws-controller-manager-89775f59b-rxzs9\" (UID: \"c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff\") " pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:13.739771 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.739638 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff-metrics-cert\") pod \"lws-controller-manager-89775f59b-rxzs9\" (UID: \"c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff\") " pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:13.739771 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.739661 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff-cert\") pod \"lws-controller-manager-89775f59b-rxzs9\" (UID: \"c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff\") " pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:13.740273 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.740249 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff-manager-config\") pod \"lws-controller-manager-89775f59b-rxzs9\" (UID: \"c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff\") " pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:13.742169 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.742142 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff-metrics-cert\") pod \"lws-controller-manager-89775f59b-rxzs9\" (UID: \"c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff\") " pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:13.742482 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.742457 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff-cert\") pod \"lws-controller-manager-89775f59b-rxzs9\" (UID: \"c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff\") " pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:13.751772 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.751746 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vlg6\" (UniqueName: \"kubernetes.io/projected/c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff-kube-api-access-6vlg6\") pod \"lws-controller-manager-89775f59b-rxzs9\" (UID: \"c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff\") " pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:13.858987 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.858904 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:13.989126 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:13.989101 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9"] Jul 12 19:29:13.991635 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:29:13.991613 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3cda036_67de_4f79_bfd8_a0e3d1a6f0ff.slice/crio-e312d72ee0db78f6476a8ea5e57a613f20c34215176317d12be38e54e5623c0d WatchSource:0}: Error finding container e312d72ee0db78f6476a8ea5e57a613f20c34215176317d12be38e54e5623c0d: Status 404 returned error can't find the container with id e312d72ee0db78f6476a8ea5e57a613f20c34215176317d12be38e54e5623c0d Jul 12 19:29:14.099306 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:14.099249 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" event={"ID":"c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff","Type":"ContainerStarted","Data":"e312d72ee0db78f6476a8ea5e57a613f20c34215176317d12be38e54e5623c0d"} Jul 12 19:29:17.114987 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:17.114946 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" event={"ID":"c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff","Type":"ContainerStarted","Data":"d2afa0e0a64162b9ae4b50cad482b3cdd736d18dea698258d3a35ef09d56b4ba"} Jul 12 19:29:17.115379 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:17.115120 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:17.146141 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:17.146094 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" podStartSLOduration=1.8204776489999999 podStartE2EDuration="4.146078432s" totalImagesPullingTime="2.325600783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:29:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:29:17.144867061 +0000 UTC m=+556.678855262" watchObservedRunningTime="2026-07-12 19:29:17.146078432 +0000 UTC m=+556.680066607" Jul 12 19:29:24.554401 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.554362 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s"] Jul 12 19:29:24.557834 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.557813 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.560600 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.560573 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 12 19:29:24.560909 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.560889 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 12 19:29:24.561021 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.560889 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 12 19:29:24.561021 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.560990 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4cqmv\"" Jul 12 19:29:24.561171 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.561154 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 12 19:29:24.576257 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.575485 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s"] Jul 12 19:29:24.630361 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.630330 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrb77\" (UniqueName: \"kubernetes.io/projected/6553d1e0-17a1-4dfe-9ce1-4944940146d6-kube-api-access-wrb77\") pod \"opendatahub-operator-controller-manager-68dff8c9d6-7hx4s\" (UID: \"6553d1e0-17a1-4dfe-9ce1-4944940146d6\") " pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.630361 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.630366 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6553d1e0-17a1-4dfe-9ce1-4944940146d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68dff8c9d6-7hx4s\" (UID: \"6553d1e0-17a1-4dfe-9ce1-4944940146d6\") " pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.630560 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.630396 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6553d1e0-17a1-4dfe-9ce1-4944940146d6-manifests\") pod \"opendatahub-operator-controller-manager-68dff8c9d6-7hx4s\" (UID: \"6553d1e0-17a1-4dfe-9ce1-4944940146d6\") " pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.630560 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.630419 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6553d1e0-17a1-4dfe-9ce1-4944940146d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-68dff8c9d6-7hx4s\" (UID: \"6553d1e0-17a1-4dfe-9ce1-4944940146d6\") " pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.630560 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.630480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6553d1e0-17a1-4dfe-9ce1-4944940146d6-tmp\") pod \"opendatahub-operator-controller-manager-68dff8c9d6-7hx4s\" (UID: \"6553d1e0-17a1-4dfe-9ce1-4944940146d6\") " pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.731539 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.731507 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrb77\" (UniqueName: \"kubernetes.io/projected/6553d1e0-17a1-4dfe-9ce1-4944940146d6-kube-api-access-wrb77\") pod \"opendatahub-operator-controller-manager-68dff8c9d6-7hx4s\" (UID: \"6553d1e0-17a1-4dfe-9ce1-4944940146d6\") " pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.731539 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.731542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6553d1e0-17a1-4dfe-9ce1-4944940146d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68dff8c9d6-7hx4s\" (UID: \"6553d1e0-17a1-4dfe-9ce1-4944940146d6\") " pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.731716 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.731562 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6553d1e0-17a1-4dfe-9ce1-4944940146d6-manifests\") pod \"opendatahub-operator-controller-manager-68dff8c9d6-7hx4s\" (UID: \"6553d1e0-17a1-4dfe-9ce1-4944940146d6\") " pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.731716 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.731583 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6553d1e0-17a1-4dfe-9ce1-4944940146d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-68dff8c9d6-7hx4s\" (UID: \"6553d1e0-17a1-4dfe-9ce1-4944940146d6\") " pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.731716 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.731649 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6553d1e0-17a1-4dfe-9ce1-4944940146d6-tmp\") pod \"opendatahub-operator-controller-manager-68dff8c9d6-7hx4s\" (UID: \"6553d1e0-17a1-4dfe-9ce1-4944940146d6\") " pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.732067 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.732037 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6553d1e0-17a1-4dfe-9ce1-4944940146d6-manifests\") pod \"opendatahub-operator-controller-manager-68dff8c9d6-7hx4s\" (UID: \"6553d1e0-17a1-4dfe-9ce1-4944940146d6\") " pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.734197 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.734166 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6553d1e0-17a1-4dfe-9ce1-4944940146d6-tmp\") pod \"opendatahub-operator-controller-manager-68dff8c9d6-7hx4s\" (UID: \"6553d1e0-17a1-4dfe-9ce1-4944940146d6\") " pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.734337 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.734315 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6553d1e0-17a1-4dfe-9ce1-4944940146d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68dff8c9d6-7hx4s\" (UID: \"6553d1e0-17a1-4dfe-9ce1-4944940146d6\") " pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.734400 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.734334 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6553d1e0-17a1-4dfe-9ce1-4944940146d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-68dff8c9d6-7hx4s\" (UID: \"6553d1e0-17a1-4dfe-9ce1-4944940146d6\") " pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.743070 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.743050 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrb77\" (UniqueName: \"kubernetes.io/projected/6553d1e0-17a1-4dfe-9ce1-4944940146d6-kube-api-access-wrb77\") pod \"opendatahub-operator-controller-manager-68dff8c9d6-7hx4s\" (UID: \"6553d1e0-17a1-4dfe-9ce1-4944940146d6\") " pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:24.868521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:24.868434 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:25.009162 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:29:25.009132 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6553d1e0_17a1_4dfe_9ce1_4944940146d6.slice/crio-385c8836604af785d1980502098ddcf22a0f0b83854fc086ca9d38c424cdb53b WatchSource:0}: Error finding container 385c8836604af785d1980502098ddcf22a0f0b83854fc086ca9d38c424cdb53b: Status 404 returned error can't find the container with id 385c8836604af785d1980502098ddcf22a0f0b83854fc086ca9d38c424cdb53b Jul 12 19:29:25.011366 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:25.011267 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s"] Jul 12 19:29:25.150372 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:25.150337 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" event={"ID":"6553d1e0-17a1-4dfe-9ce1-4944940146d6","Type":"ContainerStarted","Data":"385c8836604af785d1980502098ddcf22a0f0b83854fc086ca9d38c424cdb53b"} Jul 12 19:29:28.124644 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:28.124617 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-89775f59b-rxzs9" Jul 12 19:29:28.169839 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:28.169810 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" event={"ID":"6553d1e0-17a1-4dfe-9ce1-4944940146d6","Type":"ContainerStarted","Data":"fe98048a0f4c35e1f7a854d1eb4db33187f8de5226381af092bcb6e139be442c"} Jul 12 19:29:30.180255 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:30.180222 2572 generic.go:356] "Generic (PLEG): container finished" podID="6553d1e0-17a1-4dfe-9ce1-4944940146d6" containerID="fe98048a0f4c35e1f7a854d1eb4db33187f8de5226381af092bcb6e139be442c" exitCode=0 Jul 12 19:29:30.180642 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:30.180316 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" event={"ID":"6553d1e0-17a1-4dfe-9ce1-4944940146d6","Type":"ContainerDied","Data":"fe98048a0f4c35e1f7a854d1eb4db33187f8de5226381af092bcb6e139be442c"} Jul 12 19:29:31.186976 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:31.186944 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" event={"ID":"6553d1e0-17a1-4dfe-9ce1-4944940146d6","Type":"ContainerStarted","Data":"71ad6a52c349caa1dbf488130944fda25a04a905b41a8fbeb5f50cae49df828d"} Jul 12 19:29:31.187386 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:31.187163 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:31.208206 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:31.208166 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" podStartSLOduration=2.748996354 podStartE2EDuration="7.20815024s" totalImagesPullingTime="3.405979034s" totalInitContainerRuntime="1.053174852s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:29:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:29:31.206824836 +0000 UTC m=+570.740813010" watchObservedRunningTime="2026-07-12 19:29:31.20815024 +0000 UTC m=+570.742138415" Jul 12 19:29:42.194258 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:42.194229 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68dff8c9d6-7hx4s" Jul 12 19:29:44.169568 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.169530 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw"] Jul 12 19:29:44.177889 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.177862 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw" Jul 12 19:29:44.181539 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.181516 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 12 19:29:44.181539 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.181525 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 12 19:29:44.181709 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.181568 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 12 19:29:44.182253 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.182230 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 12 19:29:44.182389 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.182265 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wqx6k\"" Jul 12 19:29:44.188122 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.188101 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw"] Jul 12 19:29:44.302190 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.302160 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b98xp\" (UniqueName: \"kubernetes.io/projected/aa049892-e6e1-434d-ac2e-79e45bd343ac-kube-api-access-b98xp\") pod \"kube-auth-proxy-59ff7fb449-4g9pw\" (UID: \"aa049892-e6e1-434d-ac2e-79e45bd343ac\") " pod="openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw" Jul 12 19:29:44.302438 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.302199 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa049892-e6e1-434d-ac2e-79e45bd343ac-tmp\") pod \"kube-auth-proxy-59ff7fb449-4g9pw\" (UID: \"aa049892-e6e1-434d-ac2e-79e45bd343ac\") " pod="openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw" Jul 12 19:29:44.302438 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.302239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa049892-e6e1-434d-ac2e-79e45bd343ac-tls-certs\") pod \"kube-auth-proxy-59ff7fb449-4g9pw\" (UID: \"aa049892-e6e1-434d-ac2e-79e45bd343ac\") " pod="openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw" Jul 12 19:29:44.403627 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.403594 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b98xp\" (UniqueName: \"kubernetes.io/projected/aa049892-e6e1-434d-ac2e-79e45bd343ac-kube-api-access-b98xp\") pod \"kube-auth-proxy-59ff7fb449-4g9pw\" (UID: \"aa049892-e6e1-434d-ac2e-79e45bd343ac\") " pod="openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw" Jul 12 19:29:44.403627 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.403634 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa049892-e6e1-434d-ac2e-79e45bd343ac-tmp\") pod \"kube-auth-proxy-59ff7fb449-4g9pw\" (UID: \"aa049892-e6e1-434d-ac2e-79e45bd343ac\") " pod="openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw" Jul 12 19:29:44.403843 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.403754 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa049892-e6e1-434d-ac2e-79e45bd343ac-tls-certs\") pod \"kube-auth-proxy-59ff7fb449-4g9pw\" (UID: \"aa049892-e6e1-434d-ac2e-79e45bd343ac\") " pod="openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw" Jul 12 19:29:44.403926 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:29:44.403907 2572 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 12 19:29:44.404008 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:29:44.403996 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa049892-e6e1-434d-ac2e-79e45bd343ac-tls-certs podName:aa049892-e6e1-434d-ac2e-79e45bd343ac nodeName:}" failed. No retries permitted until 2026-07-12 19:29:44.903974364 +0000 UTC m=+584.437962531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/aa049892-e6e1-434d-ac2e-79e45bd343ac-tls-certs") pod "kube-auth-proxy-59ff7fb449-4g9pw" (UID: "aa049892-e6e1-434d-ac2e-79e45bd343ac") : secret "kube-auth-proxy-tls" not found Jul 12 19:29:44.405818 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.405795 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa049892-e6e1-434d-ac2e-79e45bd343ac-tmp\") pod \"kube-auth-proxy-59ff7fb449-4g9pw\" (UID: \"aa049892-e6e1-434d-ac2e-79e45bd343ac\") " pod="openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw" Jul 12 19:29:44.415398 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.415365 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b98xp\" (UniqueName: \"kubernetes.io/projected/aa049892-e6e1-434d-ac2e-79e45bd343ac-kube-api-access-b98xp\") pod \"kube-auth-proxy-59ff7fb449-4g9pw\" (UID: \"aa049892-e6e1-434d-ac2e-79e45bd343ac\") " pod="openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw" Jul 12 19:29:44.908989 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.908945 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa049892-e6e1-434d-ac2e-79e45bd343ac-tls-certs\") pod \"kube-auth-proxy-59ff7fb449-4g9pw\" (UID: \"aa049892-e6e1-434d-ac2e-79e45bd343ac\") " pod="openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw" Jul 12 19:29:44.911492 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:44.911463 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa049892-e6e1-434d-ac2e-79e45bd343ac-tls-certs\") pod \"kube-auth-proxy-59ff7fb449-4g9pw\" (UID: \"aa049892-e6e1-434d-ac2e-79e45bd343ac\") " pod="openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw" Jul 12 19:29:45.088542 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:45.088510 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw" Jul 12 19:29:45.227035 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:45.226882 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw"] Jul 12 19:29:45.229895 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:29:45.229867 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa049892_e6e1_434d_ac2e_79e45bd343ac.slice/crio-7f9d3bde53bbb45b039071b3cfc63f957b223a1f5775ccbc0400cfe9f55e0d4f WatchSource:0}: Error finding container 7f9d3bde53bbb45b039071b3cfc63f957b223a1f5775ccbc0400cfe9f55e0d4f: Status 404 returned error can't find the container with id 7f9d3bde53bbb45b039071b3cfc63f957b223a1f5775ccbc0400cfe9f55e0d4f Jul 12 19:29:45.249115 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:45.249085 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw" event={"ID":"aa049892-e6e1-434d-ac2e-79e45bd343ac","Type":"ContainerStarted","Data":"7f9d3bde53bbb45b039071b3cfc63f957b223a1f5775ccbc0400cfe9f55e0d4f"} Jul 12 19:29:48.266149 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:48.266117 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw" event={"ID":"aa049892-e6e1-434d-ac2e-79e45bd343ac","Type":"ContainerStarted","Data":"d538a48b1daa9544584083b0a1cce815c1ddcdba8c2f241cc418046a56686e15"} Jul 12 19:29:48.283054 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:29:48.283001 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59ff7fb449-4g9pw" podStartSLOduration=1.6974371289999999 podStartE2EDuration="4.28298649s" totalImagesPullingTime="2.585549361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:29:48.281487487 +0000 UTC m=+587.815475659" watchObservedRunningTime="2026-07-12 19:29:48.28298649 +0000 UTC m=+587.816974664" Jul 12 19:31:42.054730 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.054689 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml"] Jul 12 19:31:42.058068 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.058045 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml" Jul 12 19:31:42.060771 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.060743 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 12 19:31:42.060908 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.060777 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 12 19:31:42.060908 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.060889 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kcwqf\"" Jul 12 19:31:42.072589 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.072569 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml"] Jul 12 19:31:42.138616 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.138587 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cccd239b-72db-46a4-a7a5-b3e833a0a62e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6h7ml\" (UID: \"cccd239b-72db-46a4-a7a5-b3e833a0a62e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml" Jul 12 19:31:42.138781 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.138620 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkdk8\" (UniqueName: \"kubernetes.io/projected/cccd239b-72db-46a4-a7a5-b3e833a0a62e-kube-api-access-vkdk8\") pod \"kuadrant-operator-controller-manager-55467d9f7-6h7ml\" (UID: \"cccd239b-72db-46a4-a7a5-b3e833a0a62e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml" Jul 12 19:31:42.164319 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.164277 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml"] Jul 12 19:31:42.164574 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:31:42.164553 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-vkdk8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml" podUID="cccd239b-72db-46a4-a7a5-b3e833a0a62e" Jul 12 19:31:42.239582 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.239549 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cccd239b-72db-46a4-a7a5-b3e833a0a62e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6h7ml\" (UID: \"cccd239b-72db-46a4-a7a5-b3e833a0a62e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml" Jul 12 19:31:42.239582 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.239581 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkdk8\" (UniqueName: \"kubernetes.io/projected/cccd239b-72db-46a4-a7a5-b3e833a0a62e-kube-api-access-vkdk8\") pod \"kuadrant-operator-controller-manager-55467d9f7-6h7ml\" (UID: \"cccd239b-72db-46a4-a7a5-b3e833a0a62e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml" Jul 12 19:31:42.239917 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.239899 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cccd239b-72db-46a4-a7a5-b3e833a0a62e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6h7ml\" (UID: \"cccd239b-72db-46a4-a7a5-b3e833a0a62e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml" Jul 12 19:31:42.250086 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.250061 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkdk8\" (UniqueName: \"kubernetes.io/projected/cccd239b-72db-46a4-a7a5-b3e833a0a62e-kube-api-access-vkdk8\") pod \"kuadrant-operator-controller-manager-55467d9f7-6h7ml\" (UID: \"cccd239b-72db-46a4-a7a5-b3e833a0a62e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml" Jul 12 19:31:42.251901 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.251880 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml"] Jul 12 19:31:42.262898 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.262876 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml"] Jul 12 19:31:42.340623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.340534 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv"] Jul 12 19:31:42.344142 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.344121 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" Jul 12 19:31:42.373189 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.373161 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv"] Jul 12 19:31:42.441822 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.441782 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjtm2\" (UniqueName: \"kubernetes.io/projected/06b1e119-0fc4-4ff6-9d63-ae435ad4cbee-kube-api-access-kjtm2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmggv\" (UID: \"06b1e119-0fc4-4ff6-9d63-ae435ad4cbee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" Jul 12 19:31:42.442007 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.441861 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06b1e119-0fc4-4ff6-9d63-ae435ad4cbee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmggv\" (UID: \"06b1e119-0fc4-4ff6-9d63-ae435ad4cbee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" Jul 12 19:31:42.543094 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.543059 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjtm2\" (UniqueName: \"kubernetes.io/projected/06b1e119-0fc4-4ff6-9d63-ae435ad4cbee-kube-api-access-kjtm2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmggv\" (UID: \"06b1e119-0fc4-4ff6-9d63-ae435ad4cbee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" Jul 12 19:31:42.543263 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.543126 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06b1e119-0fc4-4ff6-9d63-ae435ad4cbee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmggv\" (UID: \"06b1e119-0fc4-4ff6-9d63-ae435ad4cbee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" Jul 12 19:31:42.543530 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.543513 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06b1e119-0fc4-4ff6-9d63-ae435ad4cbee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmggv\" (UID: \"06b1e119-0fc4-4ff6-9d63-ae435ad4cbee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" Jul 12 19:31:42.553894 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.553872 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjtm2\" (UniqueName: \"kubernetes.io/projected/06b1e119-0fc4-4ff6-9d63-ae435ad4cbee-kube-api-access-kjtm2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmggv\" (UID: \"06b1e119-0fc4-4ff6-9d63-ae435ad4cbee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" Jul 12 19:31:42.656732 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.656692 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" Jul 12 19:31:42.784675 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.784640 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml" Jul 12 19:31:42.787105 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:31:42.787078 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6h7ml\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="cccd239b-72db-46a4-a7a5-b3e833a0a62e" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml" Jul 12 19:31:42.792481 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.792463 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml" Jul 12 19:31:42.794786 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:31:42.794764 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6h7ml\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="cccd239b-72db-46a4-a7a5-b3e833a0a62e" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml" Jul 12 19:31:42.803046 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.803026 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv"] Jul 12 19:31:42.806236 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:31:42.806215 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b1e119_0fc4_4ff6_9d63_ae435ad4cbee.slice/crio-864444da50d4c3bd16df7a9be03c5e75b0df0aa227855b401c70782a94b5754c WatchSource:0}: Error finding container 864444da50d4c3bd16df7a9be03c5e75b0df0aa227855b401c70782a94b5754c: Status 404 returned error can't find the container with id 864444da50d4c3bd16df7a9be03c5e75b0df0aa227855b401c70782a94b5754c Jul 12 19:31:42.808513 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.808494 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 19:31:42.845359 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.845334 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cccd239b-72db-46a4-a7a5-b3e833a0a62e-extensions-socket-volume\") pod \"cccd239b-72db-46a4-a7a5-b3e833a0a62e\" (UID: \"cccd239b-72db-46a4-a7a5-b3e833a0a62e\") " Jul 12 19:31:42.845499 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.845384 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkdk8\" (UniqueName: \"kubernetes.io/projected/cccd239b-72db-46a4-a7a5-b3e833a0a62e-kube-api-access-vkdk8\") pod \"cccd239b-72db-46a4-a7a5-b3e833a0a62e\" (UID: \"cccd239b-72db-46a4-a7a5-b3e833a0a62e\") " Jul 12 19:31:42.845565 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.845501 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cccd239b-72db-46a4-a7a5-b3e833a0a62e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cccd239b-72db-46a4-a7a5-b3e833a0a62e" (UID: "cccd239b-72db-46a4-a7a5-b3e833a0a62e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:31:42.845635 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.845621 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cccd239b-72db-46a4-a7a5-b3e833a0a62e-extensions-socket-volume\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:31:42.847556 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.847534 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cccd239b-72db-46a4-a7a5-b3e833a0a62e-kube-api-access-vkdk8" (OuterVolumeSpecName: "kube-api-access-vkdk8") pod "cccd239b-72db-46a4-a7a5-b3e833a0a62e" (UID: "cccd239b-72db-46a4-a7a5-b3e833a0a62e"). InnerVolumeSpecName "kube-api-access-vkdk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:31:42.946630 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:42.946545 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkdk8\" (UniqueName: \"kubernetes.io/projected/cccd239b-72db-46a4-a7a5-b3e833a0a62e-kube-api-access-vkdk8\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:31:43.011397 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:43.011362 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cccd239b-72db-46a4-a7a5-b3e833a0a62e" path="/var/lib/kubelet/pods/cccd239b-72db-46a4-a7a5-b3e833a0a62e/volumes" Jul 12 19:31:43.793323 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:43.793263 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" event={"ID":"06b1e119-0fc4-4ff6-9d63-ae435ad4cbee","Type":"ContainerStarted","Data":"864444da50d4c3bd16df7a9be03c5e75b0df0aa227855b401c70782a94b5754c"} Jul 12 19:31:43.793323 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:43.793318 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml" Jul 12 19:31:43.798962 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:31:43.798916 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6h7ml\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="cccd239b-72db-46a4-a7a5-b3e833a0a62e" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6h7ml" Jul 12 19:31:47.815495 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:47.815465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" event={"ID":"06b1e119-0fc4-4ff6-9d63-ae435ad4cbee","Type":"ContainerStarted","Data":"c2d3c77bf1d2f5dfb23ae0385c3e22ad44bc0794e7b8048ae1c3a89b121ba0f9"} Jul 12 19:31:47.815910 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:47.815597 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" Jul 12 19:31:47.832848 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:47.832805 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" podStartSLOduration=0.910447206 podStartE2EDuration="5.832791465s" totalImagesPullingTime="4.922344259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:31:47.832360878 +0000 UTC m=+707.366349054" watchObservedRunningTime="2026-07-12 19:31:47.832791465 +0000 UTC m=+707.366779641" Jul 12 19:31:58.822116 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:31:58.822040 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" Jul 12 19:32:04.684714 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:04.684676 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv"] Jul 12 19:32:04.685175 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:04.684887 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" podUID="06b1e119-0fc4-4ff6-9d63-ae435ad4cbee" containerName="manager" containerID="cri-o://c2d3c77bf1d2f5dfb23ae0385c3e22ad44bc0794e7b8048ae1c3a89b121ba0f9" gracePeriod=10 Jul 12 19:32:05.738646 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.738623 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" Jul 12 19:32:05.857485 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.857402 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06b1e119-0fc4-4ff6-9d63-ae435ad4cbee-extensions-socket-volume\") pod \"06b1e119-0fc4-4ff6-9d63-ae435ad4cbee\" (UID: \"06b1e119-0fc4-4ff6-9d63-ae435ad4cbee\") " Jul 12 19:32:05.857628 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.857521 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjtm2\" (UniqueName: \"kubernetes.io/projected/06b1e119-0fc4-4ff6-9d63-ae435ad4cbee-kube-api-access-kjtm2\") pod \"06b1e119-0fc4-4ff6-9d63-ae435ad4cbee\" (UID: \"06b1e119-0fc4-4ff6-9d63-ae435ad4cbee\") " Jul 12 19:32:05.857837 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.857817 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06b1e119-0fc4-4ff6-9d63-ae435ad4cbee-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "06b1e119-0fc4-4ff6-9d63-ae435ad4cbee" (UID: "06b1e119-0fc4-4ff6-9d63-ae435ad4cbee"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:32:05.859853 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.859832 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06b1e119-0fc4-4ff6-9d63-ae435ad4cbee-kube-api-access-kjtm2" (OuterVolumeSpecName: "kube-api-access-kjtm2") pod "06b1e119-0fc4-4ff6-9d63-ae435ad4cbee" (UID: "06b1e119-0fc4-4ff6-9d63-ae435ad4cbee"). InnerVolumeSpecName "kube-api-access-kjtm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:32:05.900564 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.900532 2572 generic.go:356] "Generic (PLEG): container finished" podID="06b1e119-0fc4-4ff6-9d63-ae435ad4cbee" containerID="c2d3c77bf1d2f5dfb23ae0385c3e22ad44bc0794e7b8048ae1c3a89b121ba0f9" exitCode=0 Jul 12 19:32:05.900706 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.900568 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" event={"ID":"06b1e119-0fc4-4ff6-9d63-ae435ad4cbee","Type":"ContainerDied","Data":"c2d3c77bf1d2f5dfb23ae0385c3e22ad44bc0794e7b8048ae1c3a89b121ba0f9"} Jul 12 19:32:05.900706 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.900619 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" event={"ID":"06b1e119-0fc4-4ff6-9d63-ae435ad4cbee","Type":"ContainerDied","Data":"864444da50d4c3bd16df7a9be03c5e75b0df0aa227855b401c70782a94b5754c"} Jul 12 19:32:05.900706 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.900576 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv" Jul 12 19:32:05.900706 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.900649 2572 scope.go:117] "RemoveContainer" containerID="c2d3c77bf1d2f5dfb23ae0385c3e22ad44bc0794e7b8048ae1c3a89b121ba0f9" Jul 12 19:32:05.909321 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.909300 2572 scope.go:117] "RemoveContainer" containerID="c2d3c77bf1d2f5dfb23ae0385c3e22ad44bc0794e7b8048ae1c3a89b121ba0f9" Jul 12 19:32:05.909606 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:32:05.909588 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2d3c77bf1d2f5dfb23ae0385c3e22ad44bc0794e7b8048ae1c3a89b121ba0f9\": container with ID starting with c2d3c77bf1d2f5dfb23ae0385c3e22ad44bc0794e7b8048ae1c3a89b121ba0f9 not found: ID does not exist" containerID="c2d3c77bf1d2f5dfb23ae0385c3e22ad44bc0794e7b8048ae1c3a89b121ba0f9" Jul 12 19:32:05.909654 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.909617 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d3c77bf1d2f5dfb23ae0385c3e22ad44bc0794e7b8048ae1c3a89b121ba0f9"} err="failed to get container status \"c2d3c77bf1d2f5dfb23ae0385c3e22ad44bc0794e7b8048ae1c3a89b121ba0f9\": rpc error: code = NotFound desc = could not find container \"c2d3c77bf1d2f5dfb23ae0385c3e22ad44bc0794e7b8048ae1c3a89b121ba0f9\": container with ID starting with c2d3c77bf1d2f5dfb23ae0385c3e22ad44bc0794e7b8048ae1c3a89b121ba0f9 not found: ID does not exist" Jul 12 19:32:05.921306 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.921271 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv"] Jul 12 19:32:05.924961 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.924940 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmggv"] Jul 12 19:32:05.958641 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.958618 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjtm2\" (UniqueName: \"kubernetes.io/projected/06b1e119-0fc4-4ff6-9d63-ae435ad4cbee-kube-api-access-kjtm2\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:32:05.958641 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:05.958641 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06b1e119-0fc4-4ff6-9d63-ae435ad4cbee-extensions-socket-volume\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:32:07.012904 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:07.012871 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06b1e119-0fc4-4ff6-9d63-ae435ad4cbee" path="/var/lib/kubelet/pods/06b1e119-0fc4-4ff6-9d63-ae435ad4cbee/volumes" Jul 12 19:32:26.010017 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.009985 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-66n77"] Jul 12 19:32:26.010425 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.010336 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06b1e119-0fc4-4ff6-9d63-ae435ad4cbee" containerName="manager" Jul 12 19:32:26.010425 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.010347 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="06b1e119-0fc4-4ff6-9d63-ae435ad4cbee" containerName="manager" Jul 12 19:32:26.010425 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.010421 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="06b1e119-0fc4-4ff6-9d63-ae435ad4cbee" containerName="manager" Jul 12 19:32:26.012480 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.012457 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" Jul 12 19:32:26.014856 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.014832 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 12 19:32:26.014974 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.014954 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 12 19:32:26.015035 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.014965 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 12 19:32:26.015978 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.015962 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qlwpj\"" Jul 12 19:32:26.020186 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.020158 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-66n77"] Jul 12 19:32:26.038001 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.037975 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpnnp\" (UniqueName: \"kubernetes.io/projected/fe3678f4-954a-4850-bd2f-eb56e8f51bf4-kube-api-access-lpnnp\") pod \"limitador-limitador-64c94fd64f-66n77\" (UID: \"fe3678f4-954a-4850-bd2f-eb56e8f51bf4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" Jul 12 19:32:26.038105 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.038088 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe3678f4-954a-4850-bd2f-eb56e8f51bf4-config-file\") pod \"limitador-limitador-64c94fd64f-66n77\" (UID: \"fe3678f4-954a-4850-bd2f-eb56e8f51bf4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" Jul 12 19:32:26.113086 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.113016 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-66n77"] Jul 12 19:32:26.139225 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.139188 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe3678f4-954a-4850-bd2f-eb56e8f51bf4-config-file\") pod \"limitador-limitador-64c94fd64f-66n77\" (UID: \"fe3678f4-954a-4850-bd2f-eb56e8f51bf4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" Jul 12 19:32:26.139412 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.139242 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpnnp\" (UniqueName: \"kubernetes.io/projected/fe3678f4-954a-4850-bd2f-eb56e8f51bf4-kube-api-access-lpnnp\") pod \"limitador-limitador-64c94fd64f-66n77\" (UID: \"fe3678f4-954a-4850-bd2f-eb56e8f51bf4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" Jul 12 19:32:26.139837 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.139817 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe3678f4-954a-4850-bd2f-eb56e8f51bf4-config-file\") pod \"limitador-limitador-64c94fd64f-66n77\" (UID: \"fe3678f4-954a-4850-bd2f-eb56e8f51bf4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" Jul 12 19:32:26.147108 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.147081 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpnnp\" (UniqueName: \"kubernetes.io/projected/fe3678f4-954a-4850-bd2f-eb56e8f51bf4-kube-api-access-lpnnp\") pod \"limitador-limitador-64c94fd64f-66n77\" (UID: \"fe3678f4-954a-4850-bd2f-eb56e8f51bf4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" Jul 12 19:32:26.323858 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.323765 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" Jul 12 19:32:26.449719 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.449694 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-66n77"] Jul 12 19:32:26.452067 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:32:26.452032 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3678f4_954a_4850_bd2f_eb56e8f51bf4.slice/crio-63a17016e61539131787c079aba3001de91607b9c49390cc6b69755a3a6a9211 WatchSource:0}: Error finding container 63a17016e61539131787c079aba3001de91607b9c49390cc6b69755a3a6a9211: Status 404 returned error can't find the container with id 63a17016e61539131787c079aba3001de91607b9c49390cc6b69755a3a6a9211 Jul 12 19:32:26.789089 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.789054 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-c6z8w"] Jul 12 19:32:26.792278 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.792261 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c6z8w" Jul 12 19:32:26.794878 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.794852 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jdrdk\"" Jul 12 19:32:26.802896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.802877 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-c6z8w"] Jul 12 19:32:26.844465 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.844427 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59257\" (UniqueName: \"kubernetes.io/projected/f09c4158-2d19-45d2-afe9-bbb8e960dd4b-kube-api-access-59257\") pod \"authorino-58cd955675-c6z8w\" (UID: \"f09c4158-2d19-45d2-afe9-bbb8e960dd4b\") " pod="kuadrant-system/authorino-58cd955675-c6z8w" Jul 12 19:32:26.945663 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.945632 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59257\" (UniqueName: \"kubernetes.io/projected/f09c4158-2d19-45d2-afe9-bbb8e960dd4b-kube-api-access-59257\") pod \"authorino-58cd955675-c6z8w\" (UID: \"f09c4158-2d19-45d2-afe9-bbb8e960dd4b\") " pod="kuadrant-system/authorino-58cd955675-c6z8w" Jul 12 19:32:26.956476 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:26.956439 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59257\" (UniqueName: \"kubernetes.io/projected/f09c4158-2d19-45d2-afe9-bbb8e960dd4b-kube-api-access-59257\") pod \"authorino-58cd955675-c6z8w\" (UID: \"f09c4158-2d19-45d2-afe9-bbb8e960dd4b\") " pod="kuadrant-system/authorino-58cd955675-c6z8w" Jul 12 19:32:27.003706 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:27.003675 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" event={"ID":"fe3678f4-954a-4850-bd2f-eb56e8f51bf4","Type":"ContainerStarted","Data":"63a17016e61539131787c079aba3001de91607b9c49390cc6b69755a3a6a9211"} Jul 12 19:32:27.101891 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:27.101782 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c6z8w" Jul 12 19:32:27.282088 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:27.281465 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-c6z8w"] Jul 12 19:32:27.291217 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:32:27.291134 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf09c4158_2d19_45d2_afe9_bbb8e960dd4b.slice/crio-a3b7a2365b06f426493d40faa495f8006ab8ceff779df40ab3f9611b5a0974d0 WatchSource:0}: Error finding container a3b7a2365b06f426493d40faa495f8006ab8ceff779df40ab3f9611b5a0974d0: Status 404 returned error can't find the container with id a3b7a2365b06f426493d40faa495f8006ab8ceff779df40ab3f9611b5a0974d0 Jul 12 19:32:28.013651 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:28.013608 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c6z8w" event={"ID":"f09c4158-2d19-45d2-afe9-bbb8e960dd4b","Type":"ContainerStarted","Data":"a3b7a2365b06f426493d40faa495f8006ab8ceff779df40ab3f9611b5a0974d0"} Jul 12 19:32:30.841001 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:30.840964 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-c6z8w"] Jul 12 19:32:31.031343 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:31.031310 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c6z8w" event={"ID":"f09c4158-2d19-45d2-afe9-bbb8e960dd4b","Type":"ContainerStarted","Data":"e39b6644d5c3520bb283d169da449e920cdf9b95462ae351784d4efa2f6206d3"} Jul 12 19:32:31.031513 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:31.031340 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-c6z8w" podUID="f09c4158-2d19-45d2-afe9-bbb8e960dd4b" containerName="authorino" containerID="cri-o://e39b6644d5c3520bb283d169da449e920cdf9b95462ae351784d4efa2f6206d3" gracePeriod=30 Jul 12 19:32:31.033371 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:31.033261 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" event={"ID":"fe3678f4-954a-4850-bd2f-eb56e8f51bf4","Type":"ContainerStarted","Data":"6d95f701517451b83363dbe276fad67fc516fc44420fe4de3fa8a7c511d21dc3"} Jul 12 19:32:31.033533 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:31.033404 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" Jul 12 19:32:31.046679 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:31.046633 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-c6z8w" podStartSLOduration=1.395745408 podStartE2EDuration="5.046616135s" totalImagesPullingTime="3.650870727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:32:31.045353232 +0000 UTC m=+750.579341408" watchObservedRunningTime="2026-07-12 19:32:31.046616135 +0000 UTC m=+750.580604310" Jul 12 19:32:31.063421 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:31.063370 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" podStartSLOduration=1.574721116 podStartE2EDuration="6.063350574s" totalImagesPullingTime="4.488629458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:32:31.063165782 +0000 UTC m=+750.597153959" watchObservedRunningTime="2026-07-12 19:32:31.063350574 +0000 UTC m=+750.597338742" Jul 12 19:32:31.284522 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:31.284495 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c6z8w" Jul 12 19:32:31.390087 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:31.390050 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59257\" (UniqueName: \"kubernetes.io/projected/f09c4158-2d19-45d2-afe9-bbb8e960dd4b-kube-api-access-59257\") pod \"f09c4158-2d19-45d2-afe9-bbb8e960dd4b\" (UID: \"f09c4158-2d19-45d2-afe9-bbb8e960dd4b\") " Jul 12 19:32:31.392178 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:31.392146 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f09c4158-2d19-45d2-afe9-bbb8e960dd4b-kube-api-access-59257" (OuterVolumeSpecName: "kube-api-access-59257") pod "f09c4158-2d19-45d2-afe9-bbb8e960dd4b" (UID: "f09c4158-2d19-45d2-afe9-bbb8e960dd4b"). InnerVolumeSpecName "kube-api-access-59257". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:32:31.491375 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:31.491272 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59257\" (UniqueName: \"kubernetes.io/projected/f09c4158-2d19-45d2-afe9-bbb8e960dd4b-kube-api-access-59257\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:32:32.039175 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:32.039140 2572 generic.go:356] "Generic (PLEG): container finished" podID="f09c4158-2d19-45d2-afe9-bbb8e960dd4b" containerID="e39b6644d5c3520bb283d169da449e920cdf9b95462ae351784d4efa2f6206d3" exitCode=2 Jul 12 19:32:32.039613 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:32.039185 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c6z8w" Jul 12 19:32:32.039613 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:32.039225 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c6z8w" event={"ID":"f09c4158-2d19-45d2-afe9-bbb8e960dd4b","Type":"ContainerDied","Data":"e39b6644d5c3520bb283d169da449e920cdf9b95462ae351784d4efa2f6206d3"} Jul 12 19:32:32.039613 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:32.039263 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c6z8w" event={"ID":"f09c4158-2d19-45d2-afe9-bbb8e960dd4b","Type":"ContainerDied","Data":"a3b7a2365b06f426493d40faa495f8006ab8ceff779df40ab3f9611b5a0974d0"} Jul 12 19:32:32.039613 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:32.039306 2572 scope.go:117] "RemoveContainer" containerID="e39b6644d5c3520bb283d169da449e920cdf9b95462ae351784d4efa2f6206d3" Jul 12 19:32:32.048263 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:32.048244 2572 scope.go:117] "RemoveContainer" containerID="e39b6644d5c3520bb283d169da449e920cdf9b95462ae351784d4efa2f6206d3" Jul 12 19:32:32.048589 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:32:32.048570 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e39b6644d5c3520bb283d169da449e920cdf9b95462ae351784d4efa2f6206d3\": container with ID starting with e39b6644d5c3520bb283d169da449e920cdf9b95462ae351784d4efa2f6206d3 not found: ID does not exist" containerID="e39b6644d5c3520bb283d169da449e920cdf9b95462ae351784d4efa2f6206d3" Jul 12 19:32:32.048655 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:32.048602 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e39b6644d5c3520bb283d169da449e920cdf9b95462ae351784d4efa2f6206d3"} err="failed to get container status \"e39b6644d5c3520bb283d169da449e920cdf9b95462ae351784d4efa2f6206d3\": rpc error: code = NotFound desc = could not find container \"e39b6644d5c3520bb283d169da449e920cdf9b95462ae351784d4efa2f6206d3\": container with ID starting with e39b6644d5c3520bb283d169da449e920cdf9b95462ae351784d4efa2f6206d3 not found: ID does not exist" Jul 12 19:32:32.059238 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:32.059217 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-c6z8w"] Jul 12 19:32:32.062684 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:32.062665 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-c6z8w"] Jul 12 19:32:33.010993 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:33.010959 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f09c4158-2d19-45d2-afe9-bbb8e960dd4b" path="/var/lib/kubelet/pods/f09c4158-2d19-45d2-afe9-bbb8e960dd4b/volumes" Jul 12 19:32:41.072844 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:41.072811 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-66n77"] Jul 12 19:32:41.073270 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:41.073004 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" podUID="fe3678f4-954a-4850-bd2f-eb56e8f51bf4" containerName="limitador" containerID="cri-o://6d95f701517451b83363dbe276fad67fc516fc44420fe4de3fa8a7c511d21dc3" gracePeriod=30 Jul 12 19:32:41.073742 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:41.073724 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" Jul 12 19:32:41.619321 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:41.619274 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" Jul 12 19:32:41.685798 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:41.685707 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe3678f4-954a-4850-bd2f-eb56e8f51bf4-config-file\") pod \"fe3678f4-954a-4850-bd2f-eb56e8f51bf4\" (UID: \"fe3678f4-954a-4850-bd2f-eb56e8f51bf4\") " Jul 12 19:32:41.685798 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:41.685766 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpnnp\" (UniqueName: \"kubernetes.io/projected/fe3678f4-954a-4850-bd2f-eb56e8f51bf4-kube-api-access-lpnnp\") pod \"fe3678f4-954a-4850-bd2f-eb56e8f51bf4\" (UID: \"fe3678f4-954a-4850-bd2f-eb56e8f51bf4\") " Jul 12 19:32:41.686127 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:41.686103 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe3678f4-954a-4850-bd2f-eb56e8f51bf4-config-file" (OuterVolumeSpecName: "config-file") pod "fe3678f4-954a-4850-bd2f-eb56e8f51bf4" (UID: "fe3678f4-954a-4850-bd2f-eb56e8f51bf4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:32:41.687966 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:41.687938 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe3678f4-954a-4850-bd2f-eb56e8f51bf4-kube-api-access-lpnnp" (OuterVolumeSpecName: "kube-api-access-lpnnp") pod "fe3678f4-954a-4850-bd2f-eb56e8f51bf4" (UID: "fe3678f4-954a-4850-bd2f-eb56e8f51bf4"). InnerVolumeSpecName "kube-api-access-lpnnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:32:41.786741 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:41.786707 2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe3678f4-954a-4850-bd2f-eb56e8f51bf4-config-file\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:32:41.786741 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:41.786735 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpnnp\" (UniqueName: \"kubernetes.io/projected/fe3678f4-954a-4850-bd2f-eb56e8f51bf4-kube-api-access-lpnnp\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:32:42.086496 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:42.086411 2572 generic.go:356] "Generic (PLEG): container finished" podID="fe3678f4-954a-4850-bd2f-eb56e8f51bf4" containerID="6d95f701517451b83363dbe276fad67fc516fc44420fe4de3fa8a7c511d21dc3" exitCode=0 Jul 12 19:32:42.086496 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:42.086460 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" Jul 12 19:32:42.086955 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:42.086498 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" event={"ID":"fe3678f4-954a-4850-bd2f-eb56e8f51bf4","Type":"ContainerDied","Data":"6d95f701517451b83363dbe276fad67fc516fc44420fe4de3fa8a7c511d21dc3"} Jul 12 19:32:42.086955 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:42.086551 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-66n77" event={"ID":"fe3678f4-954a-4850-bd2f-eb56e8f51bf4","Type":"ContainerDied","Data":"63a17016e61539131787c079aba3001de91607b9c49390cc6b69755a3a6a9211"} Jul 12 19:32:42.086955 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:42.086573 2572 scope.go:117] "RemoveContainer" containerID="6d95f701517451b83363dbe276fad67fc516fc44420fe4de3fa8a7c511d21dc3" Jul 12 19:32:42.095399 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:42.095378 2572 scope.go:117] "RemoveContainer" containerID="6d95f701517451b83363dbe276fad67fc516fc44420fe4de3fa8a7c511d21dc3" Jul 12 19:32:42.095674 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:32:42.095654 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d95f701517451b83363dbe276fad67fc516fc44420fe4de3fa8a7c511d21dc3\": container with ID starting with 6d95f701517451b83363dbe276fad67fc516fc44420fe4de3fa8a7c511d21dc3 not found: ID does not exist" containerID="6d95f701517451b83363dbe276fad67fc516fc44420fe4de3fa8a7c511d21dc3" Jul 12 19:32:42.095722 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:42.095682 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d95f701517451b83363dbe276fad67fc516fc44420fe4de3fa8a7c511d21dc3"} err="failed to get container status \"6d95f701517451b83363dbe276fad67fc516fc44420fe4de3fa8a7c511d21dc3\": rpc error: code = NotFound desc = could not find container \"6d95f701517451b83363dbe276fad67fc516fc44420fe4de3fa8a7c511d21dc3\": container with ID starting with 6d95f701517451b83363dbe276fad67fc516fc44420fe4de3fa8a7c511d21dc3 not found: ID does not exist" Jul 12 19:32:42.106248 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:42.106224 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-66n77"] Jul 12 19:32:42.109603 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:42.109583 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-66n77"] Jul 12 19:32:43.011030 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:43.010999 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe3678f4-954a-4850-bd2f-eb56e8f51bf4" path="/var/lib/kubelet/pods/fe3678f4-954a-4850-bd2f-eb56e8f51bf4/volumes" Jul 12 19:32:44.437321 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.437263 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd"] Jul 12 19:32:44.437861 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.437843 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe3678f4-954a-4850-bd2f-eb56e8f51bf4" containerName="limitador" Jul 12 19:32:44.437907 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.437864 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe3678f4-954a-4850-bd2f-eb56e8f51bf4" containerName="limitador" Jul 12 19:32:44.437907 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.437880 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f09c4158-2d19-45d2-afe9-bbb8e960dd4b" containerName="authorino" Jul 12 19:32:44.437907 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.437889 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f09c4158-2d19-45d2-afe9-bbb8e960dd4b" containerName="authorino" Jul 12 19:32:44.438035 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.438024 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f09c4158-2d19-45d2-afe9-bbb8e960dd4b" containerName="authorino" Jul 12 19:32:44.438070 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.438038 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe3678f4-954a-4850-bd2f-eb56e8f51bf4" containerName="limitador" Jul 12 19:32:44.442627 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.442603 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd" Jul 12 19:32:44.445592 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.445567 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 12 19:32:44.445715 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.445569 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 12 19:32:44.446721 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.446704 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-xj2gh\"" Jul 12 19:32:44.447397 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.447044 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 12 19:32:44.448487 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.448468 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd"] Jul 12 19:32:44.515516 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.515485 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/96dc7442-1cff-4c9e-8042-5073c6b4ac54-data\") pod \"postgres-69fb4594cf-ql7kd\" (UID: \"96dc7442-1cff-4c9e-8042-5073c6b4ac54\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd" Jul 12 19:32:44.515688 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.515582 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78zl8\" (UniqueName: \"kubernetes.io/projected/96dc7442-1cff-4c9e-8042-5073c6b4ac54-kube-api-access-78zl8\") pod \"postgres-69fb4594cf-ql7kd\" (UID: \"96dc7442-1cff-4c9e-8042-5073c6b4ac54\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd" Jul 12 19:32:44.616746 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.616712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/96dc7442-1cff-4c9e-8042-5073c6b4ac54-data\") pod \"postgres-69fb4594cf-ql7kd\" (UID: \"96dc7442-1cff-4c9e-8042-5073c6b4ac54\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd" Jul 12 19:32:44.616925 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.616783 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78zl8\" (UniqueName: \"kubernetes.io/projected/96dc7442-1cff-4c9e-8042-5073c6b4ac54-kube-api-access-78zl8\") pod \"postgres-69fb4594cf-ql7kd\" (UID: \"96dc7442-1cff-4c9e-8042-5073c6b4ac54\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd" Jul 12 19:32:44.617147 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.617125 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/96dc7442-1cff-4c9e-8042-5073c6b4ac54-data\") pod \"postgres-69fb4594cf-ql7kd\" (UID: \"96dc7442-1cff-4c9e-8042-5073c6b4ac54\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd" Jul 12 19:32:44.625656 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.625632 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78zl8\" (UniqueName: \"kubernetes.io/projected/96dc7442-1cff-4c9e-8042-5073c6b4ac54-kube-api-access-78zl8\") pod \"postgres-69fb4594cf-ql7kd\" (UID: \"96dc7442-1cff-4c9e-8042-5073c6b4ac54\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd" Jul 12 19:32:44.754520 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.754426 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd" Jul 12 19:32:44.886718 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:44.886689 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd"] Jul 12 19:32:44.888399 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:32:44.888372 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96dc7442_1cff_4c9e_8042_5073c6b4ac54.slice/crio-b0f277ca490668a9c786d768d594f36a8a96dbe2b4360671b6fcf8f00d728951 WatchSource:0}: Error finding container b0f277ca490668a9c786d768d594f36a8a96dbe2b4360671b6fcf8f00d728951: Status 404 returned error can't find the container with id b0f277ca490668a9c786d768d594f36a8a96dbe2b4360671b6fcf8f00d728951 Jul 12 19:32:45.102180 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:45.102095 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd" event={"ID":"96dc7442-1cff-4c9e-8042-5073c6b4ac54","Type":"ContainerStarted","Data":"b0f277ca490668a9c786d768d594f36a8a96dbe2b4360671b6fcf8f00d728951"} Jul 12 19:32:50.140405 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:50.140365 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd" event={"ID":"96dc7442-1cff-4c9e-8042-5073c6b4ac54","Type":"ContainerStarted","Data":"7fbf458b640d1abf960b37f94b7cf4109ed6b492427b81eb4abd56830d5e2e93"} Jul 12 19:32:50.140917 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:50.140482 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd" Jul 12 19:32:50.154662 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:50.154614 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd" podStartSLOduration=1.378129071 podStartE2EDuration="6.154600266s" totalImagesPullingTime="4.776471195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:32:50.153936557 +0000 UTC m=+769.687924744" watchObservedRunningTime="2026-07-12 19:32:50.154600266 +0000 UTC m=+769.688588442" Jul 12 19:32:56.177695 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:56.177665 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ql7kd" Jul 12 19:32:56.742393 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:56.742361 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pr9w2"] Jul 12 19:32:56.748082 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:56.748060 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pr9w2" Jul 12 19:32:56.750741 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:56.750718 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 12 19:32:56.751132 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:56.751118 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jdrdk\"" Jul 12 19:32:56.751847 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:56.751809 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 12 19:32:56.754468 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:56.754446 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pr9w2"] Jul 12 19:32:56.830540 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:56.830498 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtfqr\" (UniqueName: \"kubernetes.io/projected/904adfd5-1661-4c22-a152-0921f2f47c9d-kube-api-access-qtfqr\") pod \"authorino-5d4b67c446-pr9w2\" (UID: \"904adfd5-1661-4c22-a152-0921f2f47c9d\") " pod="kuadrant-system/authorino-5d4b67c446-pr9w2" Jul 12 19:32:56.898831 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:56.898796 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pr9w2"] Jul 12 19:32:56.899085 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:32:56.899065 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qtfqr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-pr9w2" podUID="904adfd5-1661-4c22-a152-0921f2f47c9d" Jul 12 19:32:56.920049 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:56.920017 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-fsbwj"] Jul 12 19:32:56.923852 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:56.923834 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-fsbwj" Jul 12 19:32:56.926180 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:56.926160 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 12 19:32:56.929827 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:56.929802 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-fsbwj"] Jul 12 19:32:56.931267 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:56.931233 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtfqr\" (UniqueName: \"kubernetes.io/projected/904adfd5-1661-4c22-a152-0921f2f47c9d-kube-api-access-qtfqr\") pod \"authorino-5d4b67c446-pr9w2\" (UID: \"904adfd5-1661-4c22-a152-0921f2f47c9d\") " pod="kuadrant-system/authorino-5d4b67c446-pr9w2" Jul 12 19:32:56.942224 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:56.942194 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtfqr\" (UniqueName: \"kubernetes.io/projected/904adfd5-1661-4c22-a152-0921f2f47c9d-kube-api-access-qtfqr\") pod \"authorino-5d4b67c446-pr9w2\" (UID: \"904adfd5-1661-4c22-a152-0921f2f47c9d\") " pod="kuadrant-system/authorino-5d4b67c446-pr9w2" Jul 12 19:32:57.000132 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.000045 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-fsbwj"] Jul 12 19:32:57.000380 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:32:57.000360 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lzjn2 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-fsbwj" podUID="21530d0d-e86d-45d7-afb6-719946fc06f1" Jul 12 19:32:57.025881 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.025840 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85f886c487-4mz82"] Jul 12 19:32:57.029708 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.029685 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85f886c487-4mz82" Jul 12 19:32:57.032130 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.032101 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21530d0d-e86d-45d7-afb6-719946fc06f1-tls-cert\") pod \"authorino-76877994-fsbwj\" (UID: \"21530d0d-e86d-45d7-afb6-719946fc06f1\") " pod="kuadrant-system/authorino-76877994-fsbwj" Jul 12 19:32:57.032240 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.032153 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzjn2\" (UniqueName: \"kubernetes.io/projected/21530d0d-e86d-45d7-afb6-719946fc06f1-kube-api-access-lzjn2\") pod \"authorino-76877994-fsbwj\" (UID: \"21530d0d-e86d-45d7-afb6-719946fc06f1\") " pod="kuadrant-system/authorino-76877994-fsbwj" Jul 12 19:32:57.037526 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.037498 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85f886c487-4mz82"] Jul 12 19:32:57.133515 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.133478 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21530d0d-e86d-45d7-afb6-719946fc06f1-tls-cert\") pod \"authorino-76877994-fsbwj\" (UID: \"21530d0d-e86d-45d7-afb6-719946fc06f1\") " pod="kuadrant-system/authorino-76877994-fsbwj" Jul 12 19:32:57.133515 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.133519 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dfa9ee62-4ab5-4f07-afd9-fd60742ab97c-tls-cert\") pod \"authorino-85f886c487-4mz82\" (UID: \"dfa9ee62-4ab5-4f07-afd9-fd60742ab97c\") " pod="kuadrant-system/authorino-85f886c487-4mz82" Jul 12 19:32:57.133777 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.133538 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6mtx\" (UniqueName: \"kubernetes.io/projected/dfa9ee62-4ab5-4f07-afd9-fd60742ab97c-kube-api-access-p6mtx\") pod \"authorino-85f886c487-4mz82\" (UID: \"dfa9ee62-4ab5-4f07-afd9-fd60742ab97c\") " pod="kuadrant-system/authorino-85f886c487-4mz82" Jul 12 19:32:57.133777 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.133567 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzjn2\" (UniqueName: \"kubernetes.io/projected/21530d0d-e86d-45d7-afb6-719946fc06f1-kube-api-access-lzjn2\") pod \"authorino-76877994-fsbwj\" (UID: \"21530d0d-e86d-45d7-afb6-719946fc06f1\") " pod="kuadrant-system/authorino-76877994-fsbwj" Jul 12 19:32:57.136207 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.136182 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21530d0d-e86d-45d7-afb6-719946fc06f1-tls-cert\") pod \"authorino-76877994-fsbwj\" (UID: \"21530d0d-e86d-45d7-afb6-719946fc06f1\") " pod="kuadrant-system/authorino-76877994-fsbwj" Jul 12 19:32:57.140855 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.140828 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzjn2\" (UniqueName: \"kubernetes.io/projected/21530d0d-e86d-45d7-afb6-719946fc06f1-kube-api-access-lzjn2\") pod \"authorino-76877994-fsbwj\" (UID: \"21530d0d-e86d-45d7-afb6-719946fc06f1\") " pod="kuadrant-system/authorino-76877994-fsbwj" Jul 12 19:32:57.172387 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.172361 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pr9w2" Jul 12 19:32:57.172535 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.172361 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-fsbwj" Jul 12 19:32:57.180090 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.180057 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pr9w2" Jul 12 19:32:57.182627 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.182612 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-fsbwj" Jul 12 19:32:57.234244 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.234211 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dfa9ee62-4ab5-4f07-afd9-fd60742ab97c-tls-cert\") pod \"authorino-85f886c487-4mz82\" (UID: \"dfa9ee62-4ab5-4f07-afd9-fd60742ab97c\") " pod="kuadrant-system/authorino-85f886c487-4mz82" Jul 12 19:32:57.234244 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.234247 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6mtx\" (UniqueName: \"kubernetes.io/projected/dfa9ee62-4ab5-4f07-afd9-fd60742ab97c-kube-api-access-p6mtx\") pod \"authorino-85f886c487-4mz82\" (UID: \"dfa9ee62-4ab5-4f07-afd9-fd60742ab97c\") " pod="kuadrant-system/authorino-85f886c487-4mz82" Jul 12 19:32:57.236825 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.236794 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dfa9ee62-4ab5-4f07-afd9-fd60742ab97c-tls-cert\") pod \"authorino-85f886c487-4mz82\" (UID: \"dfa9ee62-4ab5-4f07-afd9-fd60742ab97c\") " pod="kuadrant-system/authorino-85f886c487-4mz82" Jul 12 19:32:57.241266 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.241243 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6mtx\" (UniqueName: \"kubernetes.io/projected/dfa9ee62-4ab5-4f07-afd9-fd60742ab97c-kube-api-access-p6mtx\") pod \"authorino-85f886c487-4mz82\" (UID: \"dfa9ee62-4ab5-4f07-afd9-fd60742ab97c\") " pod="kuadrant-system/authorino-85f886c487-4mz82" Jul 12 19:32:57.335464 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.335361 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21530d0d-e86d-45d7-afb6-719946fc06f1-tls-cert\") pod \"21530d0d-e86d-45d7-afb6-719946fc06f1\" (UID: \"21530d0d-e86d-45d7-afb6-719946fc06f1\") " Jul 12 19:32:57.335618 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.335479 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtfqr\" (UniqueName: \"kubernetes.io/projected/904adfd5-1661-4c22-a152-0921f2f47c9d-kube-api-access-qtfqr\") pod \"904adfd5-1661-4c22-a152-0921f2f47c9d\" (UID: \"904adfd5-1661-4c22-a152-0921f2f47c9d\") " Jul 12 19:32:57.335618 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.335545 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzjn2\" (UniqueName: \"kubernetes.io/projected/21530d0d-e86d-45d7-afb6-719946fc06f1-kube-api-access-lzjn2\") pod \"21530d0d-e86d-45d7-afb6-719946fc06f1\" (UID: \"21530d0d-e86d-45d7-afb6-719946fc06f1\") " Jul 12 19:32:57.337679 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.337645 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21530d0d-e86d-45d7-afb6-719946fc06f1-kube-api-access-lzjn2" (OuterVolumeSpecName: "kube-api-access-lzjn2") pod "21530d0d-e86d-45d7-afb6-719946fc06f1" (UID: "21530d0d-e86d-45d7-afb6-719946fc06f1"). InnerVolumeSpecName "kube-api-access-lzjn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:32:57.337679 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.337670 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21530d0d-e86d-45d7-afb6-719946fc06f1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "21530d0d-e86d-45d7-afb6-719946fc06f1" (UID: "21530d0d-e86d-45d7-afb6-719946fc06f1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:32:57.337830 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.337680 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/904adfd5-1661-4c22-a152-0921f2f47c9d-kube-api-access-qtfqr" (OuterVolumeSpecName: "kube-api-access-qtfqr") pod "904adfd5-1661-4c22-a152-0921f2f47c9d" (UID: "904adfd5-1661-4c22-a152-0921f2f47c9d"). InnerVolumeSpecName "kube-api-access-qtfqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:32:57.339816 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.339801 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85f886c487-4mz82" Jul 12 19:32:57.437045 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.437005 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtfqr\" (UniqueName: \"kubernetes.io/projected/904adfd5-1661-4c22-a152-0921f2f47c9d-kube-api-access-qtfqr\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:32:57.437045 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.437046 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzjn2\" (UniqueName: \"kubernetes.io/projected/21530d0d-e86d-45d7-afb6-719946fc06f1-kube-api-access-lzjn2\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:32:57.437303 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.437060 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21530d0d-e86d-45d7-afb6-719946fc06f1-tls-cert\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:32:57.473932 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:57.473906 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85f886c487-4mz82"] Jul 12 19:32:57.476494 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:32:57.476468 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfa9ee62_4ab5_4f07_afd9_fd60742ab97c.slice/crio-9ba1bf104bf2468d9a8c5f6ab798fbe61c97749e96ac5e84c05f693f7c508f8d WatchSource:0}: Error finding container 9ba1bf104bf2468d9a8c5f6ab798fbe61c97749e96ac5e84c05f693f7c508f8d: Status 404 returned error can't find the container with id 9ba1bf104bf2468d9a8c5f6ab798fbe61c97749e96ac5e84c05f693f7c508f8d Jul 12 19:32:58.179554 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:58.179528 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pr9w2" Jul 12 19:32:58.179554 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:58.179513 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85f886c487-4mz82" event={"ID":"dfa9ee62-4ab5-4f07-afd9-fd60742ab97c","Type":"ContainerStarted","Data":"786c2aba7f59464c1e709810d12f35b491f7cdb90db09bc2917f27b52e877e18"} Jul 12 19:32:58.179834 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:58.179588 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85f886c487-4mz82" event={"ID":"dfa9ee62-4ab5-4f07-afd9-fd60742ab97c","Type":"ContainerStarted","Data":"9ba1bf104bf2468d9a8c5f6ab798fbe61c97749e96ac5e84c05f693f7c508f8d"} Jul 12 19:32:58.179834 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:58.179675 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-fsbwj" Jul 12 19:32:58.195854 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:58.195809 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85f886c487-4mz82" podStartSLOduration=0.846152087 podStartE2EDuration="1.195791979s" totalImagesPullingTime="349.639892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:32:58.193607472 +0000 UTC m=+777.727595651" watchObservedRunningTime="2026-07-12 19:32:58.195791979 +0000 UTC m=+777.729780351" Jul 12 19:32:58.215501 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:58.215469 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pr9w2"] Jul 12 19:32:58.223104 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:58.223078 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pr9w2"] Jul 12 19:32:58.244664 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:58.244634 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-fsbwj"] Jul 12 19:32:58.250139 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:58.250118 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-fsbwj"] Jul 12 19:32:59.011042 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:59.011009 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21530d0d-e86d-45d7-afb6-719946fc06f1" path="/var/lib/kubelet/pods/21530d0d-e86d-45d7-afb6-719946fc06f1/volumes" Jul 12 19:32:59.011244 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:32:59.011233 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="904adfd5-1661-4c22-a152-0921f2f47c9d" path="/var/lib/kubelet/pods/904adfd5-1661-4c22-a152-0921f2f47c9d/volumes" Jul 12 19:33:02.634585 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.634548 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8476d89dc8-gm9sb"] Jul 12 19:33:02.707875 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.707836 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8476d89dc8-gm9sb"] Jul 12 19:33:02.708031 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.707882 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8476d89dc8-gm9sb" Jul 12 19:33:02.710683 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.710659 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-v6v94\"" Jul 12 19:33:02.710806 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.710687 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 12 19:33:02.710806 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.710669 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 12 19:33:02.809567 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.809534 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5699dc8655-cfdcr"] Jul 12 19:33:02.833045 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.833014 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5699dc8655-cfdcr"] Jul 12 19:33:02.833194 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.833059 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5699dc8655-cfdcr" Jul 12 19:33:02.886312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.886209 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f-webhook-cert\") pod \"maas-controller-8476d89dc8-gm9sb\" (UID: \"2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f\") " pod="opendatahub/maas-controller-8476d89dc8-gm9sb" Jul 12 19:33:02.886312 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.886265 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6r7z\" (UniqueName: \"kubernetes.io/projected/2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f-kube-api-access-m6r7z\") pod \"maas-controller-8476d89dc8-gm9sb\" (UID: \"2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f\") " pod="opendatahub/maas-controller-8476d89dc8-gm9sb" Jul 12 19:33:02.986899 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.986861 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6r7z\" (UniqueName: \"kubernetes.io/projected/2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f-kube-api-access-m6r7z\") pod \"maas-controller-8476d89dc8-gm9sb\" (UID: \"2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f\") " pod="opendatahub/maas-controller-8476d89dc8-gm9sb" Jul 12 19:33:02.987090 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.986932 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/668e8df8-0592-4ae2-bcec-c766112bc5b0-webhook-cert\") pod \"maas-controller-5699dc8655-cfdcr\" (UID: \"668e8df8-0592-4ae2-bcec-c766112bc5b0\") " pod="opendatahub/maas-controller-5699dc8655-cfdcr" Jul 12 19:33:02.987090 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.986987 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj55n\" (UniqueName: \"kubernetes.io/projected/668e8df8-0592-4ae2-bcec-c766112bc5b0-kube-api-access-gj55n\") pod \"maas-controller-5699dc8655-cfdcr\" (UID: \"668e8df8-0592-4ae2-bcec-c766112bc5b0\") " pod="opendatahub/maas-controller-5699dc8655-cfdcr" Jul 12 19:33:02.987090 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.987027 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f-webhook-cert\") pod \"maas-controller-8476d89dc8-gm9sb\" (UID: \"2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f\") " pod="opendatahub/maas-controller-8476d89dc8-gm9sb" Jul 12 19:33:02.989586 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.989564 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f-webhook-cert\") pod \"maas-controller-8476d89dc8-gm9sb\" (UID: \"2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f\") " pod="opendatahub/maas-controller-8476d89dc8-gm9sb" Jul 12 19:33:02.994993 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:02.994972 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6r7z\" (UniqueName: \"kubernetes.io/projected/2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f-kube-api-access-m6r7z\") pod \"maas-controller-8476d89dc8-gm9sb\" (UID: \"2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f\") " pod="opendatahub/maas-controller-8476d89dc8-gm9sb" Jul 12 19:33:03.017719 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:03.017695 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8476d89dc8-gm9sb" Jul 12 19:33:03.088613 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:03.088574 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/668e8df8-0592-4ae2-bcec-c766112bc5b0-webhook-cert\") pod \"maas-controller-5699dc8655-cfdcr\" (UID: \"668e8df8-0592-4ae2-bcec-c766112bc5b0\") " pod="opendatahub/maas-controller-5699dc8655-cfdcr" Jul 12 19:33:03.088805 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:03.088637 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj55n\" (UniqueName: \"kubernetes.io/projected/668e8df8-0592-4ae2-bcec-c766112bc5b0-kube-api-access-gj55n\") pod \"maas-controller-5699dc8655-cfdcr\" (UID: \"668e8df8-0592-4ae2-bcec-c766112bc5b0\") " pod="opendatahub/maas-controller-5699dc8655-cfdcr" Jul 12 19:33:03.091518 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:03.091491 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/668e8df8-0592-4ae2-bcec-c766112bc5b0-webhook-cert\") pod \"maas-controller-5699dc8655-cfdcr\" (UID: \"668e8df8-0592-4ae2-bcec-c766112bc5b0\") " pod="opendatahub/maas-controller-5699dc8655-cfdcr" Jul 12 19:33:03.097754 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:03.097727 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj55n\" (UniqueName: \"kubernetes.io/projected/668e8df8-0592-4ae2-bcec-c766112bc5b0-kube-api-access-gj55n\") pod \"maas-controller-5699dc8655-cfdcr\" (UID: \"668e8df8-0592-4ae2-bcec-c766112bc5b0\") " pod="opendatahub/maas-controller-5699dc8655-cfdcr" Jul 12 19:33:03.143659 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:03.143588 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5699dc8655-cfdcr" Jul 12 19:33:03.304273 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:03.304232 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5699dc8655-cfdcr"] Jul 12 19:33:03.328216 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:33:03.328185 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod668e8df8_0592_4ae2_bcec_c766112bc5b0.slice/crio-3c05258648b2e9f58dd8a652fdad9d91fbe9bb612f2579f4af689c25f4c24d81 WatchSource:0}: Error finding container 3c05258648b2e9f58dd8a652fdad9d91fbe9bb612f2579f4af689c25f4c24d81: Status 404 returned error can't find the container with id 3c05258648b2e9f58dd8a652fdad9d91fbe9bb612f2579f4af689c25f4c24d81 Jul 12 19:33:03.391524 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:03.391499 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8476d89dc8-gm9sb"] Jul 12 19:33:03.393448 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:33:03.393418 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd2fd85_57b1_43ae_a55b_0ac7dc8fee1f.slice/crio-c62139f8bf124701bc482d88f3b9e76463dd6ceb88f9f93558dae08a28bd1df9 WatchSource:0}: Error finding container c62139f8bf124701bc482d88f3b9e76463dd6ceb88f9f93558dae08a28bd1df9: Status 404 returned error can't find the container with id c62139f8bf124701bc482d88f3b9e76463dd6ceb88f9f93558dae08a28bd1df9 Jul 12 19:33:04.211742 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:04.211704 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5699dc8655-cfdcr" event={"ID":"668e8df8-0592-4ae2-bcec-c766112bc5b0","Type":"ContainerStarted","Data":"3c05258648b2e9f58dd8a652fdad9d91fbe9bb612f2579f4af689c25f4c24d81"} Jul 12 19:33:04.216881 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:04.216841 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8476d89dc8-gm9sb" event={"ID":"2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f","Type":"ContainerStarted","Data":"c62139f8bf124701bc482d88f3b9e76463dd6ceb88f9f93558dae08a28bd1df9"} Jul 12 19:33:06.231059 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:06.230960 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5699dc8655-cfdcr" event={"ID":"668e8df8-0592-4ae2-bcec-c766112bc5b0","Type":"ContainerStarted","Data":"adda039d08b2de46d4ad1d63dd8a39fc8e2d9d389dbac6dcfd1efa600f0c9082"} Jul 12 19:33:06.231059 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:06.231036 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5699dc8655-cfdcr" Jul 12 19:33:06.232547 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:06.232502 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8476d89dc8-gm9sb" event={"ID":"2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f","Type":"ContainerStarted","Data":"f41e7b226e0c0a4b86aae167c8a4356c4a4770462925b2c5da50f033b947eb53"} Jul 12 19:33:06.232684 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:06.232640 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8476d89dc8-gm9sb" Jul 12 19:33:06.259416 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:06.259359 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5699dc8655-cfdcr" podStartSLOduration=1.5582446239999999 podStartE2EDuration="4.259339728s" totalImagesPullingTime="2.701095104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:33:06.258227484 +0000 UTC m=+785.792215661" watchObservedRunningTime="2026-07-12 19:33:06.259339728 +0000 UTC m=+785.793327904" Jul 12 19:33:06.286268 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:06.286211 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8476d89dc8-gm9sb" podStartSLOduration=1.659814782 podStartE2EDuration="4.286190808s" totalImagesPullingTime="2.626376026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:33:06.284480814 +0000 UTC m=+785.818468990" watchObservedRunningTime="2026-07-12 19:33:06.286190808 +0000 UTC m=+785.820178983" Jul 12 19:33:17.241623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:17.241589 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5699dc8655-cfdcr" Jul 12 19:33:17.242087 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:17.241686 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8476d89dc8-gm9sb" Jul 12 19:33:17.300624 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:17.300591 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8476d89dc8-gm9sb"] Jul 12 19:33:17.300873 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:17.300806 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8476d89dc8-gm9sb" podUID="2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f" containerName="manager" containerID="cri-o://f41e7b226e0c0a4b86aae167c8a4356c4a4770462925b2c5da50f033b947eb53" gracePeriod=30 Jul 12 19:33:17.546615 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:17.546590 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8476d89dc8-gm9sb" Jul 12 19:33:17.607649 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:17.607621 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f-webhook-cert\") pod \"2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f\" (UID: \"2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f\") " Jul 12 19:33:17.607824 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:17.607666 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6r7z\" (UniqueName: \"kubernetes.io/projected/2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f-kube-api-access-m6r7z\") pod \"2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f\" (UID: \"2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f\") " Jul 12 19:33:17.609885 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:17.609862 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f" (UID: "2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:33:17.610022 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:17.610002 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f-kube-api-access-m6r7z" (OuterVolumeSpecName: "kube-api-access-m6r7z") pod "2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f" (UID: "2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f"). InnerVolumeSpecName "kube-api-access-m6r7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:33:17.708724 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:17.708674 2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f-webhook-cert\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:33:17.708724 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:17.708717 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6r7z\" (UniqueName: \"kubernetes.io/projected/2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f-kube-api-access-m6r7z\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:33:18.290232 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:18.290199 2572 generic.go:356] "Generic (PLEG): container finished" podID="2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f" containerID="f41e7b226e0c0a4b86aae167c8a4356c4a4770462925b2c5da50f033b947eb53" exitCode=0 Jul 12 19:33:18.290666 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:18.290261 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8476d89dc8-gm9sb" Jul 12 19:33:18.290666 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:18.290313 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8476d89dc8-gm9sb" event={"ID":"2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f","Type":"ContainerDied","Data":"f41e7b226e0c0a4b86aae167c8a4356c4a4770462925b2c5da50f033b947eb53"} Jul 12 19:33:18.290666 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:18.290413 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8476d89dc8-gm9sb" event={"ID":"2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f","Type":"ContainerDied","Data":"c62139f8bf124701bc482d88f3b9e76463dd6ceb88f9f93558dae08a28bd1df9"} Jul 12 19:33:18.290666 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:18.290443 2572 scope.go:117] "RemoveContainer" containerID="f41e7b226e0c0a4b86aae167c8a4356c4a4770462925b2c5da50f033b947eb53" Jul 12 19:33:18.299773 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:18.299755 2572 scope.go:117] "RemoveContainer" containerID="f41e7b226e0c0a4b86aae167c8a4356c4a4770462925b2c5da50f033b947eb53" Jul 12 19:33:18.300067 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:33:18.300044 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f41e7b226e0c0a4b86aae167c8a4356c4a4770462925b2c5da50f033b947eb53\": container with ID starting with f41e7b226e0c0a4b86aae167c8a4356c4a4770462925b2c5da50f033b947eb53 not found: ID does not exist" containerID="f41e7b226e0c0a4b86aae167c8a4356c4a4770462925b2c5da50f033b947eb53" Jul 12 19:33:18.300118 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:18.300077 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f41e7b226e0c0a4b86aae167c8a4356c4a4770462925b2c5da50f033b947eb53"} err="failed to get container status \"f41e7b226e0c0a4b86aae167c8a4356c4a4770462925b2c5da50f033b947eb53\": rpc error: code = NotFound desc = could not find container \"f41e7b226e0c0a4b86aae167c8a4356c4a4770462925b2c5da50f033b947eb53\": container with ID starting with f41e7b226e0c0a4b86aae167c8a4356c4a4770462925b2c5da50f033b947eb53 not found: ID does not exist" Jul 12 19:33:18.314003 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:18.313977 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8476d89dc8-gm9sb"] Jul 12 19:33:18.319217 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:18.319193 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8476d89dc8-gm9sb"] Jul 12 19:33:19.011692 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:19.011661 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f" path="/var/lib/kubelet/pods/2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f/volumes" Jul 12 19:33:38.701998 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:38.701911 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8jh7k"] Jul 12 19:33:38.702460 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:38.702381 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f" containerName="manager" Jul 12 19:33:38.702460 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:38.702395 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f" containerName="manager" Jul 12 19:33:38.702460 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:38.702457 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd2fd85-57b1-43ae-a55b-0ac7dc8fee1f" containerName="manager" Jul 12 19:33:38.708151 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:38.708135 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-8jh7k" Jul 12 19:33:38.714483 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:38.711192 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bs5nc\"" Jul 12 19:33:38.714483 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:38.711516 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 12 19:33:38.717839 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:38.717812 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8jh7k"] Jul 12 19:33:38.792120 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:38.792085 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxsbs\" (UniqueName: \"kubernetes.io/projected/a2345147-f773-4400-a90c-e1e629330adb-kube-api-access-xxsbs\") pod \"payload-pre-processing-7964457696-8jh7k\" (UID: \"a2345147-f773-4400-a90c-e1e629330adb\") " pod="openshift-ingress/payload-pre-processing-7964457696-8jh7k" Jul 12 19:33:38.792321 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:38.792130 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2345147-f773-4400-a90c-e1e629330adb-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8jh7k\" (UID: \"a2345147-f773-4400-a90c-e1e629330adb\") " pod="openshift-ingress/payload-pre-processing-7964457696-8jh7k" Jul 12 19:33:38.893533 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:38.893500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxsbs\" (UniqueName: \"kubernetes.io/projected/a2345147-f773-4400-a90c-e1e629330adb-kube-api-access-xxsbs\") pod \"payload-pre-processing-7964457696-8jh7k\" (UID: \"a2345147-f773-4400-a90c-e1e629330adb\") " pod="openshift-ingress/payload-pre-processing-7964457696-8jh7k" Jul 12 19:33:38.893704 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:38.893547 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2345147-f773-4400-a90c-e1e629330adb-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8jh7k\" (UID: \"a2345147-f773-4400-a90c-e1e629330adb\") " pod="openshift-ingress/payload-pre-processing-7964457696-8jh7k" Jul 12 19:33:38.894322 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:38.894274 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2345147-f773-4400-a90c-e1e629330adb-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8jh7k\" (UID: \"a2345147-f773-4400-a90c-e1e629330adb\") " pod="openshift-ingress/payload-pre-processing-7964457696-8jh7k" Jul 12 19:33:38.901722 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:38.901694 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxsbs\" (UniqueName: \"kubernetes.io/projected/a2345147-f773-4400-a90c-e1e629330adb-kube-api-access-xxsbs\") pod \"payload-pre-processing-7964457696-8jh7k\" (UID: \"a2345147-f773-4400-a90c-e1e629330adb\") " pod="openshift-ingress/payload-pre-processing-7964457696-8jh7k" Jul 12 19:33:39.026355 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:39.026260 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-8jh7k" Jul 12 19:33:39.162724 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:39.162674 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8jh7k"] Jul 12 19:33:39.165191 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:33:39.165166 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2345147_f773_4400_a90c_e1e629330adb.slice/crio-8ae23d3e633a4a2b5aabfecce0943286c1c4e447008b0184f67a922033b7e84a WatchSource:0}: Error finding container 8ae23d3e633a4a2b5aabfecce0943286c1c4e447008b0184f67a922033b7e84a: Status 404 returned error can't find the container with id 8ae23d3e633a4a2b5aabfecce0943286c1c4e447008b0184f67a922033b7e84a Jul 12 19:33:39.390679 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:39.390649 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-8jh7k" event={"ID":"a2345147-f773-4400-a90c-e1e629330adb","Type":"ContainerStarted","Data":"8ae23d3e633a4a2b5aabfecce0943286c1c4e447008b0184f67a922033b7e84a"} Jul 12 19:33:41.402891 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:41.402849 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-8jh7k" event={"ID":"a2345147-f773-4400-a90c-e1e629330adb","Type":"ContainerStarted","Data":"00d89d29d67ef9362f13de27a8f6b90938e768fe9790b27775b32eb46de8fd9f"} Jul 12 19:33:41.403336 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:41.403013 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-8jh7k" Jul 12 19:33:41.417894 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:41.417846 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-8jh7k" podStartSLOduration=2.123592232 podStartE2EDuration="3.417831203s" totalImagesPullingTime="1.294238971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:33:41.417099073 +0000 UTC m=+820.951087250" watchObservedRunningTime="2026-07-12 19:33:41.417831203 +0000 UTC m=+820.951819380" Jul 12 19:33:52.410314 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:33:52.410262 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-8jh7k" Jul 12 19:34:07.274422 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.274388 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6"] Jul 12 19:34:07.279381 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.279357 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.282137 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.282116 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 12 19:34:07.282272 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.282117 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 12 19:34:07.282272 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.282123 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-c45j6\"" Jul 12 19:34:07.283185 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.283172 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 12 19:34:07.290364 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.290337 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6"] Jul 12 19:34:07.356472 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.356440 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/017ef789-5a05-4772-bb38-b4bc767a70ce-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.356621 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.356481 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/017ef789-5a05-4772-bb38-b4bc767a70ce-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.356621 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.356581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/017ef789-5a05-4772-bb38-b4bc767a70ce-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.356621 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.356600 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnsdf\" (UniqueName: \"kubernetes.io/projected/017ef789-5a05-4772-bb38-b4bc767a70ce-kube-api-access-dnsdf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.356724 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.356652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/017ef789-5a05-4772-bb38-b4bc767a70ce-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.356724 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.356684 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/017ef789-5a05-4772-bb38-b4bc767a70ce-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.457426 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.457393 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/017ef789-5a05-4772-bb38-b4bc767a70ce-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.457426 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.457433 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/017ef789-5a05-4772-bb38-b4bc767a70ce-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.457652 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.457498 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/017ef789-5a05-4772-bb38-b4bc767a70ce-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.457652 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.457514 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnsdf\" (UniqueName: \"kubernetes.io/projected/017ef789-5a05-4772-bb38-b4bc767a70ce-kube-api-access-dnsdf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.457652 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.457544 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/017ef789-5a05-4772-bb38-b4bc767a70ce-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.457652 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.457570 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/017ef789-5a05-4772-bb38-b4bc767a70ce-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.458196 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.457945 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/017ef789-5a05-4772-bb38-b4bc767a70ce-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.458196 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.457981 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/017ef789-5a05-4772-bb38-b4bc767a70ce-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.458196 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.457998 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/017ef789-5a05-4772-bb38-b4bc767a70ce-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.459902 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.459883 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/017ef789-5a05-4772-bb38-b4bc767a70ce-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.460013 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.460001 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/017ef789-5a05-4772-bb38-b4bc767a70ce-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.474123 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.474098 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnsdf\" (UniqueName: \"kubernetes.io/projected/017ef789-5a05-4772-bb38-b4bc767a70ce-kube-api-access-dnsdf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6\" (UID: \"017ef789-5a05-4772-bb38-b4bc767a70ce\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.591991 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.591917 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:07.726893 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:07.726870 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6"] Jul 12 19:34:07.729067 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:34:07.729044 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod017ef789_5a05_4772_bb38_b4bc767a70ce.slice/crio-1c1ca4211e7a492c9e52edd419cc63643ade75b7f3616bfa24393c7114fd103e WatchSource:0}: Error finding container 1c1ca4211e7a492c9e52edd419cc63643ade75b7f3616bfa24393c7114fd103e: Status 404 returned error can't find the container with id 1c1ca4211e7a492c9e52edd419cc63643ade75b7f3616bfa24393c7114fd103e Jul 12 19:34:08.544918 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:08.544877 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" event={"ID":"017ef789-5a05-4772-bb38-b4bc767a70ce","Type":"ContainerStarted","Data":"1c1ca4211e7a492c9e52edd419cc63643ade75b7f3616bfa24393c7114fd103e"} Jul 12 19:34:09.551176 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:09.551140 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" event={"ID":"017ef789-5a05-4772-bb38-b4bc767a70ce","Type":"ContainerStarted","Data":"3888b7960a216969d8e440f206ed06b5e907bef0dde1478c21e5f945695352a6"} Jul 12 19:34:09.567886 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:09.567839 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" podStartSLOduration=1.499379033 podStartE2EDuration="2.567822091s" totalImagesPullingTime="1.068443058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:34:09.566450279 +0000 UTC m=+849.100438458" watchObservedRunningTime="2026-07-12 19:34:09.567822091 +0000 UTC m=+849.101810266" Jul 12 19:34:17.593041 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:17.593011 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:17.593639 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:17.593073 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:17.605762 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:17.605738 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:18.603911 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:18.603884 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6" Jul 12 19:34:33.356721 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.356679 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx"] Jul 12 19:34:33.360922 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.360904 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.363479 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.363457 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 12 19:34:33.367318 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.367277 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx"] Jul 12 19:34:33.501381 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.501337 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.501592 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.501388 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gk2f\" (UniqueName: \"kubernetes.io/projected/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-kube-api-access-7gk2f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.501592 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.501460 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.501592 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.501507 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.501592 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.501542 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.501808 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.501600 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.602131 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.602092 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.602356 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.602142 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.602356 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.602170 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.602356 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.602196 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.602356 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.602232 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.602356 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.602263 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gk2f\" (UniqueName: \"kubernetes.io/projected/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-kube-api-access-7gk2f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.602665 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.602628 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.602774 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.602667 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.602774 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.602638 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.604652 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.604630 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.604932 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.604912 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.610320 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.610247 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gk2f\" (UniqueName: \"kubernetes.io/projected/92f9901d-6ec2-422f-b1f4-8ccff9a289e5-kube-api-access-7gk2f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx\" (UID: \"92f9901d-6ec2-422f-b1f4-8ccff9a289e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.672398 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.672369 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:33.803641 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:33.803617 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx"] Jul 12 19:34:33.806513 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:34:33.806479 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f9901d_6ec2_422f_b1f4_8ccff9a289e5.slice/crio-7a3e406e56b26c914226cec81df56b614fdc4af36911e74c8aa29b55eb85b8d9 WatchSource:0}: Error finding container 7a3e406e56b26c914226cec81df56b614fdc4af36911e74c8aa29b55eb85b8d9: Status 404 returned error can't find the container with id 7a3e406e56b26c914226cec81df56b614fdc4af36911e74c8aa29b55eb85b8d9 Jul 12 19:34:34.668665 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:34.668627 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" event={"ID":"92f9901d-6ec2-422f-b1f4-8ccff9a289e5","Type":"ContainerStarted","Data":"37497331dd0eb312c63ca5b29931e03439332e98a6d32462e834b4443f6f8b85"} Jul 12 19:34:34.669064 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:34.668694 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" event={"ID":"92f9901d-6ec2-422f-b1f4-8ccff9a289e5","Type":"ContainerStarted","Data":"7a3e406e56b26c914226cec81df56b614fdc4af36911e74c8aa29b55eb85b8d9"} Jul 12 19:34:34.686161 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:34.686118 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" podStartSLOduration=1.510603987 podStartE2EDuration="1.686103737s" totalImagesPullingTime="175.49975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:34:34.684632101 +0000 UTC m=+874.218620275" watchObservedRunningTime="2026-07-12 19:34:34.686103737 +0000 UTC m=+874.220091911" Jul 12 19:34:39.663651 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.663616 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv"] Jul 12 19:34:39.667295 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.667263 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.669962 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.669940 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 12 19:34:39.675313 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.675275 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv"] Jul 12 19:34:39.766322 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.766262 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6111d801-e5a1-4206-a08e-cb5c539a0cc7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.766499 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.766328 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6111d801-e5a1-4206-a08e-cb5c539a0cc7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.766499 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.766403 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6111d801-e5a1-4206-a08e-cb5c539a0cc7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.766499 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.766439 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjzg4\" (UniqueName: \"kubernetes.io/projected/6111d801-e5a1-4206-a08e-cb5c539a0cc7-kube-api-access-kjzg4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.766672 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.766508 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6111d801-e5a1-4206-a08e-cb5c539a0cc7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.766672 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.766610 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6111d801-e5a1-4206-a08e-cb5c539a0cc7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.868120 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.868088 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6111d801-e5a1-4206-a08e-cb5c539a0cc7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.868120 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.868123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6111d801-e5a1-4206-a08e-cb5c539a0cc7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.868411 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.868153 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6111d801-e5a1-4206-a08e-cb5c539a0cc7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.868411 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.868171 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjzg4\" (UniqueName: \"kubernetes.io/projected/6111d801-e5a1-4206-a08e-cb5c539a0cc7-kube-api-access-kjzg4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.868411 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.868221 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6111d801-e5a1-4206-a08e-cb5c539a0cc7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.868411 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.868270 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6111d801-e5a1-4206-a08e-cb5c539a0cc7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.868621 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.868565 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6111d801-e5a1-4206-a08e-cb5c539a0cc7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.868621 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.868612 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6111d801-e5a1-4206-a08e-cb5c539a0cc7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.868695 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.868654 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6111d801-e5a1-4206-a08e-cb5c539a0cc7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.870683 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.870662 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6111d801-e5a1-4206-a08e-cb5c539a0cc7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.870928 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.870904 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6111d801-e5a1-4206-a08e-cb5c539a0cc7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.875927 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.875907 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjzg4\" (UniqueName: \"kubernetes.io/projected/6111d801-e5a1-4206-a08e-cb5c539a0cc7-kube-api-access-kjzg4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-prfsv\" (UID: \"6111d801-e5a1-4206-a08e-cb5c539a0cc7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:39.978743 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:39.978656 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:40.116768 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:40.116738 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv"] Jul 12 19:34:40.118408 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:34:40.118383 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6111d801_e5a1_4206_a08e_cb5c539a0cc7.slice/crio-61054f26cb8e9e7fb0115d0bff509007c978a584d70caefd4c9468b9d425f0e0 WatchSource:0}: Error finding container 61054f26cb8e9e7fb0115d0bff509007c978a584d70caefd4c9468b9d425f0e0: Status 404 returned error can't find the container with id 61054f26cb8e9e7fb0115d0bff509007c978a584d70caefd4c9468b9d425f0e0 Jul 12 19:34:40.706166 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:40.706124 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" event={"ID":"6111d801-e5a1-4206-a08e-cb5c539a0cc7","Type":"ContainerStarted","Data":"0d79268ea3b977436a0646dde5472aa333d548e37c5d37aa864013f62e7a4689"} Jul 12 19:34:40.706679 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:40.706204 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" event={"ID":"6111d801-e5a1-4206-a08e-cb5c539a0cc7","Type":"ContainerStarted","Data":"61054f26cb8e9e7fb0115d0bff509007c978a584d70caefd4c9468b9d425f0e0"} Jul 12 19:34:40.723119 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:40.723062 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" podStartSLOduration=1.5601470549999998 podStartE2EDuration="1.723046335s" totalImagesPullingTime="162.89928ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:34:40.721450826 +0000 UTC m=+880.255439012" watchObservedRunningTime="2026-07-12 19:34:40.723046335 +0000 UTC m=+880.257034535" Jul 12 19:34:43.672933 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:43.672888 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:43.673372 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:43.672964 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:43.685217 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:43.685193 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:43.732555 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:43.732528 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx" Jul 12 19:34:49.978953 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:49.978914 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:49.979430 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:49.979022 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:49.992680 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:49.992657 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:34:50.767133 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:34:50.767101 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-prfsv" Jul 12 19:36:08.941216 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:08.941173 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85f886c487-4mz82"] Jul 12 19:36:08.941859 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:08.941466 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-85f886c487-4mz82" podUID="dfa9ee62-4ab5-4f07-afd9-fd60742ab97c" containerName="authorino" containerID="cri-o://786c2aba7f59464c1e709810d12f35b491f7cdb90db09bc2917f27b52e877e18" gracePeriod=30 Jul 12 19:36:09.133759 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:09.133723 2572 generic.go:356] "Generic (PLEG): container finished" podID="dfa9ee62-4ab5-4f07-afd9-fd60742ab97c" containerID="786c2aba7f59464c1e709810d12f35b491f7cdb90db09bc2917f27b52e877e18" exitCode=0 Jul 12 19:36:09.133905 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:09.133792 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85f886c487-4mz82" event={"ID":"dfa9ee62-4ab5-4f07-afd9-fd60742ab97c","Type":"ContainerDied","Data":"786c2aba7f59464c1e709810d12f35b491f7cdb90db09bc2917f27b52e877e18"} Jul 12 19:36:09.182701 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:09.182676 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85f886c487-4mz82" Jul 12 19:36:09.295036 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:09.294952 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dfa9ee62-4ab5-4f07-afd9-fd60742ab97c-tls-cert\") pod \"dfa9ee62-4ab5-4f07-afd9-fd60742ab97c\" (UID: \"dfa9ee62-4ab5-4f07-afd9-fd60742ab97c\") " Jul 12 19:36:09.295036 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:09.295014 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6mtx\" (UniqueName: \"kubernetes.io/projected/dfa9ee62-4ab5-4f07-afd9-fd60742ab97c-kube-api-access-p6mtx\") pod \"dfa9ee62-4ab5-4f07-afd9-fd60742ab97c\" (UID: \"dfa9ee62-4ab5-4f07-afd9-fd60742ab97c\") " Jul 12 19:36:09.297185 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:09.297152 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfa9ee62-4ab5-4f07-afd9-fd60742ab97c-kube-api-access-p6mtx" (OuterVolumeSpecName: "kube-api-access-p6mtx") pod "dfa9ee62-4ab5-4f07-afd9-fd60742ab97c" (UID: "dfa9ee62-4ab5-4f07-afd9-fd60742ab97c"). InnerVolumeSpecName "kube-api-access-p6mtx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:36:09.305714 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:09.305688 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfa9ee62-4ab5-4f07-afd9-fd60742ab97c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dfa9ee62-4ab5-4f07-afd9-fd60742ab97c" (UID: "dfa9ee62-4ab5-4f07-afd9-fd60742ab97c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:36:09.396259 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:09.396228 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6mtx\" (UniqueName: \"kubernetes.io/projected/dfa9ee62-4ab5-4f07-afd9-fd60742ab97c-kube-api-access-p6mtx\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:36:09.396259 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:09.396253 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dfa9ee62-4ab5-4f07-afd9-fd60742ab97c-tls-cert\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:36:10.140146 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:10.140117 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85f886c487-4mz82" Jul 12 19:36:10.140600 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:10.140116 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85f886c487-4mz82" event={"ID":"dfa9ee62-4ab5-4f07-afd9-fd60742ab97c","Type":"ContainerDied","Data":"9ba1bf104bf2468d9a8c5f6ab798fbe61c97749e96ac5e84c05f693f7c508f8d"} Jul 12 19:36:10.140600 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:10.140244 2572 scope.go:117] "RemoveContainer" containerID="786c2aba7f59464c1e709810d12f35b491f7cdb90db09bc2917f27b52e877e18" Jul 12 19:36:10.160105 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:10.160080 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85f886c487-4mz82"] Jul 12 19:36:10.163974 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:10.163953 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85f886c487-4mz82"] Jul 12 19:36:11.011940 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:36:11.011912 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfa9ee62-4ab5-4f07-afd9-fd60742ab97c" path="/var/lib/kubelet/pods/dfa9ee62-4ab5-4f07-afd9-fd60742ab97c/volumes" Jul 12 19:37:18.285540 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:18.285497 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5699dc8655-cfdcr"] Jul 12 19:37:18.285989 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:18.285723 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5699dc8655-cfdcr" podUID="668e8df8-0592-4ae2-bcec-c766112bc5b0" containerName="manager" containerID="cri-o://adda039d08b2de46d4ad1d63dd8a39fc8e2d9d389dbac6dcfd1efa600f0c9082" gracePeriod=30 Jul 12 19:37:18.461143 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:18.461115 2572 generic.go:356] "Generic (PLEG): container finished" podID="668e8df8-0592-4ae2-bcec-c766112bc5b0" containerID="adda039d08b2de46d4ad1d63dd8a39fc8e2d9d389dbac6dcfd1efa600f0c9082" exitCode=0 Jul 12 19:37:18.461311 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:18.461192 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5699dc8655-cfdcr" event={"ID":"668e8df8-0592-4ae2-bcec-c766112bc5b0","Type":"ContainerDied","Data":"adda039d08b2de46d4ad1d63dd8a39fc8e2d9d389dbac6dcfd1efa600f0c9082"} Jul 12 19:37:18.539685 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:18.539628 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5699dc8655-cfdcr" Jul 12 19:37:18.736905 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:18.736870 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj55n\" (UniqueName: \"kubernetes.io/projected/668e8df8-0592-4ae2-bcec-c766112bc5b0-kube-api-access-gj55n\") pod \"668e8df8-0592-4ae2-bcec-c766112bc5b0\" (UID: \"668e8df8-0592-4ae2-bcec-c766112bc5b0\") " Jul 12 19:37:18.737089 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:18.736959 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/668e8df8-0592-4ae2-bcec-c766112bc5b0-webhook-cert\") pod \"668e8df8-0592-4ae2-bcec-c766112bc5b0\" (UID: \"668e8df8-0592-4ae2-bcec-c766112bc5b0\") " Jul 12 19:37:18.739046 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:18.739016 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/668e8df8-0592-4ae2-bcec-c766112bc5b0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "668e8df8-0592-4ae2-bcec-c766112bc5b0" (UID: "668e8df8-0592-4ae2-bcec-c766112bc5b0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:37:18.739137 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:18.739059 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/668e8df8-0592-4ae2-bcec-c766112bc5b0-kube-api-access-gj55n" (OuterVolumeSpecName: "kube-api-access-gj55n") pod "668e8df8-0592-4ae2-bcec-c766112bc5b0" (UID: "668e8df8-0592-4ae2-bcec-c766112bc5b0"). InnerVolumeSpecName "kube-api-access-gj55n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:37:18.838614 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:18.838548 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj55n\" (UniqueName: \"kubernetes.io/projected/668e8df8-0592-4ae2-bcec-c766112bc5b0-kube-api-access-gj55n\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:37:18.838614 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:18.838574 2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/668e8df8-0592-4ae2-bcec-c766112bc5b0-webhook-cert\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:37:19.467825 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:19.467799 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5699dc8655-cfdcr" Jul 12 19:37:19.467825 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:19.467810 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5699dc8655-cfdcr" event={"ID":"668e8df8-0592-4ae2-bcec-c766112bc5b0","Type":"ContainerDied","Data":"3c05258648b2e9f58dd8a652fdad9d91fbe9bb612f2579f4af689c25f4c24d81"} Jul 12 19:37:19.468324 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:19.467863 2572 scope.go:117] "RemoveContainer" containerID="adda039d08b2de46d4ad1d63dd8a39fc8e2d9d389dbac6dcfd1efa600f0c9082" Jul 12 19:37:19.484401 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:19.484374 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5699dc8655-cfdcr"] Jul 12 19:37:19.486518 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:19.486495 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5699dc8655-cfdcr"] Jul 12 19:37:20.211828 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.211793 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5699dc8655-799lh"] Jul 12 19:37:20.212204 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.212192 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa9ee62-4ab5-4f07-afd9-fd60742ab97c" containerName="authorino" Jul 12 19:37:20.212253 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.212205 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa9ee62-4ab5-4f07-afd9-fd60742ab97c" containerName="authorino" Jul 12 19:37:20.212253 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.212218 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="668e8df8-0592-4ae2-bcec-c766112bc5b0" containerName="manager" Jul 12 19:37:20.212253 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.212223 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="668e8df8-0592-4ae2-bcec-c766112bc5b0" containerName="manager" Jul 12 19:37:20.212394 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.212310 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="668e8df8-0592-4ae2-bcec-c766112bc5b0" containerName="manager" Jul 12 19:37:20.212394 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.212326 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa9ee62-4ab5-4f07-afd9-fd60742ab97c" containerName="authorino" Jul 12 19:37:20.216665 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.216648 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5699dc8655-799lh" Jul 12 19:37:20.220594 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.220571 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-v6v94\"" Jul 12 19:37:20.220731 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.220572 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 12 19:37:20.220731 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.220624 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 12 19:37:20.224420 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.224398 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5699dc8655-799lh"] Jul 12 19:37:20.250510 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.250477 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae83e1af-89de-4146-b98d-4fa4ea6001fb-webhook-cert\") pod \"maas-controller-5699dc8655-799lh\" (UID: \"ae83e1af-89de-4146-b98d-4fa4ea6001fb\") " pod="opendatahub/maas-controller-5699dc8655-799lh" Jul 12 19:37:20.250672 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.250545 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl2lg\" (UniqueName: \"kubernetes.io/projected/ae83e1af-89de-4146-b98d-4fa4ea6001fb-kube-api-access-vl2lg\") pod \"maas-controller-5699dc8655-799lh\" (UID: \"ae83e1af-89de-4146-b98d-4fa4ea6001fb\") " pod="opendatahub/maas-controller-5699dc8655-799lh" Jul 12 19:37:20.351513 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.351478 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl2lg\" (UniqueName: \"kubernetes.io/projected/ae83e1af-89de-4146-b98d-4fa4ea6001fb-kube-api-access-vl2lg\") pod \"maas-controller-5699dc8655-799lh\" (UID: \"ae83e1af-89de-4146-b98d-4fa4ea6001fb\") " pod="opendatahub/maas-controller-5699dc8655-799lh" Jul 12 19:37:20.351734 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.351612 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae83e1af-89de-4146-b98d-4fa4ea6001fb-webhook-cert\") pod \"maas-controller-5699dc8655-799lh\" (UID: \"ae83e1af-89de-4146-b98d-4fa4ea6001fb\") " pod="opendatahub/maas-controller-5699dc8655-799lh" Jul 12 19:37:20.354179 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.354154 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae83e1af-89de-4146-b98d-4fa4ea6001fb-webhook-cert\") pod \"maas-controller-5699dc8655-799lh\" (UID: \"ae83e1af-89de-4146-b98d-4fa4ea6001fb\") " pod="opendatahub/maas-controller-5699dc8655-799lh" Jul 12 19:37:20.362270 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.362240 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl2lg\" (UniqueName: \"kubernetes.io/projected/ae83e1af-89de-4146-b98d-4fa4ea6001fb-kube-api-access-vl2lg\") pod \"maas-controller-5699dc8655-799lh\" (UID: \"ae83e1af-89de-4146-b98d-4fa4ea6001fb\") " pod="opendatahub/maas-controller-5699dc8655-799lh" Jul 12 19:37:20.528456 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.528373 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5699dc8655-799lh" Jul 12 19:37:20.659127 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.659088 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5699dc8655-799lh"] Jul 12 19:37:20.661454 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:37:20.661426 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae83e1af_89de_4146_b98d_4fa4ea6001fb.slice/crio-9b8c5316ba19d8b45c820c3464bb8f3a66346075cb30e21b7f5d451eaef4123b WatchSource:0}: Error finding container 9b8c5316ba19d8b45c820c3464bb8f3a66346075cb30e21b7f5d451eaef4123b: Status 404 returned error can't find the container with id 9b8c5316ba19d8b45c820c3464bb8f3a66346075cb30e21b7f5d451eaef4123b Jul 12 19:37:20.662764 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:20.662747 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 19:37:21.011705 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:21.011674 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="668e8df8-0592-4ae2-bcec-c766112bc5b0" path="/var/lib/kubelet/pods/668e8df8-0592-4ae2-bcec-c766112bc5b0/volumes" Jul 12 19:37:21.479076 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:21.479044 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5699dc8655-799lh" event={"ID":"ae83e1af-89de-4146-b98d-4fa4ea6001fb","Type":"ContainerStarted","Data":"9b7e84b2cd65004f8a6167045a7da002e8c50e102a041df76d8f6ae910176357"} Jul 12 19:37:21.479267 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:21.479092 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5699dc8655-799lh" event={"ID":"ae83e1af-89de-4146-b98d-4fa4ea6001fb","Type":"ContainerStarted","Data":"9b8c5316ba19d8b45c820c3464bb8f3a66346075cb30e21b7f5d451eaef4123b"} Jul 12 19:37:21.479267 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:21.479145 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5699dc8655-799lh" Jul 12 19:37:21.496056 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:21.496016 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5699dc8655-799lh" podStartSLOduration=1.051684311 podStartE2EDuration="1.496000459s" totalImagesPullingTime="444.316148ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:37:21.495021675 +0000 UTC m=+1041.029009867" watchObservedRunningTime="2026-07-12 19:37:21.496000459 +0000 UTC m=+1041.029988633" Jul 12 19:37:32.489942 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:37:32.489911 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5699dc8655-799lh" Jul 12 19:55:20.698947 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.698917 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm"] Jul 12 19:55:20.702990 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.702972 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.705464 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.705442 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 12 19:55:20.705583 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.705555 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-1f14a4-openshift-default-dockercfg-7z2mk\"" Jul 12 19:55:20.713805 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.713781 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm"] Jul 12 19:55:20.813030 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.812997 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-credential-socket\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.813209 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.813045 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-istio-data\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.813209 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.813065 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6763e79e-280a-457a-9f81-601937833336-istio-podinfo\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.813209 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.813180 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkwnb\" (UniqueName: \"kubernetes.io/projected/6763e79e-280a-457a-9f81-601937833336-kube-api-access-kkwnb\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.813375 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.813225 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-istio-envoy\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.813375 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.813315 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-workload-certs\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.813375 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.813336 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6763e79e-280a-457a-9f81-601937833336-istiod-ca-cert\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.813375 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.813373 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-workload-socket\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.813566 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.813444 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6763e79e-280a-457a-9f81-601937833336-istio-token\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.914848 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.914812 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-istio-envoy\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.915034 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.914857 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-workload-certs\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.915034 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.914886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6763e79e-280a-457a-9f81-601937833336-istiod-ca-cert\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.915034 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.914933 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-workload-socket\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.915034 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.914965 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6763e79e-280a-457a-9f81-601937833336-istio-token\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.915034 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.915020 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-credential-socket\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.915333 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.915073 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-istio-data\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.915333 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.915100 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6763e79e-280a-457a-9f81-601937833336-istio-podinfo\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.915333 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.915163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkwnb\" (UniqueName: \"kubernetes.io/projected/6763e79e-280a-457a-9f81-601937833336-kube-api-access-kkwnb\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.915490 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.915386 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-workload-certs\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.915490 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.915477 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-workload-socket\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.915690 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.915659 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-credential-socket\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.915749 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.915698 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6763e79e-280a-457a-9f81-601937833336-istiod-ca-cert\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.915749 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.915704 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-istio-data\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.917470 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.917453 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-istio-envoy\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.917815 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.917798 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6763e79e-280a-457a-9f81-601937833336-istio-podinfo\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.922604 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.922584 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6763e79e-280a-457a-9f81-601937833336-istio-token\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:20.922780 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:20.922762 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkwnb\" (UniqueName: \"kubernetes.io/projected/6763e79e-280a-457a-9f81-601937833336-kube-api-access-kkwnb\") pod \"e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:21.014322 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:21.014233 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:21.153592 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:21.153566 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm"] Jul 12 19:55:21.156918 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:55:21.156887 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6763e79e_280a_457a_9f81_601937833336.slice/crio-caefea332cf89f716b645e3f7147a12dd6cfc17d0462f7425c456930fc9b0009 WatchSource:0}: Error finding container caefea332cf89f716b645e3f7147a12dd6cfc17d0462f7425c456930fc9b0009: Status 404 returned error can't find the container with id caefea332cf89f716b645e3f7147a12dd6cfc17d0462f7425c456930fc9b0009 Jul 12 19:55:21.158887 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:21.158870 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 19:55:21.581855 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:21.581818 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" event={"ID":"6763e79e-280a-457a-9f81-601937833336","Type":"ContainerStarted","Data":"caefea332cf89f716b645e3f7147a12dd6cfc17d0462f7425c456930fc9b0009"} Jul 12 19:55:23.893654 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:23.893613 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:55:23.893915 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:23.893691 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:55:23.893915 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:23.893726 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:55:24.601270 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:24.601235 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" event={"ID":"6763e79e-280a-457a-9f81-601937833336","Type":"ContainerStarted","Data":"fbde18674570c70826f81ec0d86cfc7c00680fb11350f6c4e9c355b8dfbd134b"} Jul 12 19:55:24.620769 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:24.620699 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" podStartSLOduration=1.886450685 podStartE2EDuration="4.620683071s" totalImagesPullingTime="2.734232386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:55:24.619598134 +0000 UTC m=+2124.153586311" watchObservedRunningTime="2026-07-12 19:55:24.620683071 +0000 UTC m=+2124.154671227" Jul 12 19:55:25.014521 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:25.014489 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:25.019303 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:25.019267 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:25.606556 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:25.606526 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:25.607576 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:25.607557 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:39.677667 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:39.677580 2572 generic.go:356] "Generic (PLEG): container finished" podID="6763e79e-280a-457a-9f81-601937833336" containerID="fbde18674570c70826f81ec0d86cfc7c00680fb11350f6c4e9c355b8dfbd134b" exitCode=0 Jul 12 19:55:39.678072 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:39.677658 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" event={"ID":"6763e79e-280a-457a-9f81-601937833336","Type":"ContainerDied","Data":"fbde18674570c70826f81ec0d86cfc7c00680fb11350f6c4e9c355b8dfbd134b"} Jul 12 19:55:39.678072 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:39.678042 2572 scope.go:117] "RemoveContainer" containerID="fbde18674570c70826f81ec0d86cfc7c00680fb11350f6c4e9c355b8dfbd134b" Jul 12 19:55:39.679058 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:39.679032 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:55:39.679146 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:39.679103 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:55:39.679146 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:39.679136 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:55:40.607359 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:40.607312 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:40.687937 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:40.687905 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" event={"ID":"6763e79e-280a-457a-9f81-601937833336","Type":"ContainerStarted","Data":"1f743f7264820a67697d701633dbf39f781d071a6a81486248129d736cf07022"} Jul 12 19:55:41.015947 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:41.015900 2572 patch_prober.go:28] interesting pod/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 12 19:55:41.016156 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:41.016013 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" podUID="6763e79e-280a-457a-9f81-601937833336" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 12 19:55:41.032002 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:41.031969 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:42.015243 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:42.015197 2572 patch_prober.go:28] interesting pod/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 12 19:55:42.015760 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:42.015278 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" podUID="6763e79e-280a-457a-9f81-601937833336" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 12 19:55:43.015015 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:43.014976 2572 patch_prober.go:28] interesting pod/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 12 19:55:43.015324 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:43.015270 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" podUID="6763e79e-280a-457a-9f81-601937833336" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 12 19:55:44.014896 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:44.014848 2572 patch_prober.go:28] interesting pod/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 12 19:55:44.015110 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:44.014918 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" podUID="6763e79e-280a-457a-9f81-601937833336" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 12 19:55:45.018350 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:45.018324 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:45.018737 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:45.018674 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:55:45.019233 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:55:45.019214 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:57:24.855757 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:24.855673 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm"] Jul 12 19:57:24.856221 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:24.855922 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" podUID="6763e79e-280a-457a-9f81-601937833336" containerName="istio-proxy" containerID="cri-o://1f743f7264820a67697d701633dbf39f781d071a6a81486248129d736cf07022" gracePeriod=30 Jul 12 19:57:25.698172 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.698139 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf"] Jul 12 19:57:25.703740 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.703710 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.706761 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.706735 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-39b82d-openshift-default-dockercfg-k7fh9\"" Jul 12 19:57:25.711750 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.711725 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf"] Jul 12 19:57:25.806770 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.806729 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-podinfo\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.806969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.806831 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-workload-certs\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.806969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.806930 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-token\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.806969 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.806963 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpsfq\" (UniqueName: \"kubernetes.io/projected/c5667084-fec4-4f09-971f-0d66cf36ef5c-kube-api-access-fpsfq\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.807149 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.807049 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-data\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.807149 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.807091 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-credential-socket\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.807149 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.807126 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5667084-fec4-4f09-971f-0d66cf36ef5c-istiod-ca-cert\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.807331 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.807169 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-workload-socket\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.807331 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.807230 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-envoy\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.907930 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.907893 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-credential-socket\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.907930 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.907932 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5667084-fec4-4f09-971f-0d66cf36ef5c-istiod-ca-cert\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.908481 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.907959 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-workload-socket\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.908481 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.907988 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-envoy\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.908481 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.908030 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-podinfo\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.908481 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.908057 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-workload-certs\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.908481 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.908116 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-token\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.908481 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.908147 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpsfq\" (UniqueName: \"kubernetes.io/projected/c5667084-fec4-4f09-971f-0d66cf36ef5c-kube-api-access-fpsfq\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.908481 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.908202 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-data\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.908481 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.908374 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-credential-socket\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.908481 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.908423 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-workload-socket\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.908968 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.908528 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-workload-certs\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.908968 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.908537 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-data\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.909162 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.909140 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5667084-fec4-4f09-971f-0d66cf36ef5c-istiod-ca-cert\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.910530 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.910511 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-envoy\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.910669 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.910652 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-podinfo\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.915935 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.915915 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpsfq\" (UniqueName: \"kubernetes.io/projected/c5667084-fec4-4f09-971f-0d66cf36ef5c-kube-api-access-fpsfq\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:25.916492 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:25.916474 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-token\") pod \"e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:26.017472 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:26.017391 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:26.161726 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:26.161695 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf"] Jul 12 19:57:26.163403 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:57:26.163379 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5667084_fec4_4f09_971f_0d66cf36ef5c.slice/crio-7dc8f3cddcbe4f2a20d1d81373f4b958d14ddf4555fbad8406ee6deef122e20c WatchSource:0}: Error finding container 7dc8f3cddcbe4f2a20d1d81373f4b958d14ddf4555fbad8406ee6deef122e20c: Status 404 returned error can't find the container with id 7dc8f3cddcbe4f2a20d1d81373f4b958d14ddf4555fbad8406ee6deef122e20c Jul 12 19:57:26.166115 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:26.166082 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:57:26.166189 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:26.166166 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:57:26.166227 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:26.166210 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:57:26.192554 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:26.192521 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" event={"ID":"c5667084-fec4-4f09-971f-0d66cf36ef5c","Type":"ContainerStarted","Data":"7dc8f3cddcbe4f2a20d1d81373f4b958d14ddf4555fbad8406ee6deef122e20c"} Jul 12 19:57:27.198996 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:27.198961 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" event={"ID":"c5667084-fec4-4f09-971f-0d66cf36ef5c","Type":"ContainerStarted","Data":"ef697b7d8bad2973e83a2c10991d74250ddf0272d3981ba382b0248c80e6b9c6"} Jul 12 19:57:27.217780 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:27.217726 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" podStartSLOduration=2.217707579 podStartE2EDuration="2.217707579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:57:27.217093967 +0000 UTC m=+2246.751082146" watchObservedRunningTime="2026-07-12 19:57:27.217707579 +0000 UTC m=+2246.751695755" Jul 12 19:57:28.018325 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:28.018271 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:28.022958 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:28.022934 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:28.204358 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:28.204328 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:28.205355 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:28.205335 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:30.020716 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.020666 2572 patch_prober.go:28] interesting pod/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 12 19:57:30.021123 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.020764 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" podUID="6763e79e-280a-457a-9f81-601937833336" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 12 19:57:30.111907 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.111873 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:57:30.214663 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.214631 2572 generic.go:356] "Generic (PLEG): container finished" podID="6763e79e-280a-457a-9f81-601937833336" containerID="1f743f7264820a67697d701633dbf39f781d071a6a81486248129d736cf07022" exitCode=0 Jul 12 19:57:30.214857 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.214687 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" Jul 12 19:57:30.214857 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.214716 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" event={"ID":"6763e79e-280a-457a-9f81-601937833336","Type":"ContainerDied","Data":"1f743f7264820a67697d701633dbf39f781d071a6a81486248129d736cf07022"} Jul 12 19:57:30.214857 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.214800 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm" event={"ID":"6763e79e-280a-457a-9f81-601937833336","Type":"ContainerDied","Data":"caefea332cf89f716b645e3f7147a12dd6cfc17d0462f7425c456930fc9b0009"} Jul 12 19:57:30.214857 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.214824 2572 scope.go:117] "RemoveContainer" containerID="1f743f7264820a67697d701633dbf39f781d071a6a81486248129d736cf07022" Jul 12 19:57:30.223674 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.223656 2572 scope.go:117] "RemoveContainer" containerID="fbde18674570c70826f81ec0d86cfc7c00680fb11350f6c4e9c355b8dfbd134b" Jul 12 19:57:30.231330 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.231312 2572 scope.go:117] "RemoveContainer" containerID="1f743f7264820a67697d701633dbf39f781d071a6a81486248129d736cf07022" Jul 12 19:57:30.231583 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:57:30.231564 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f743f7264820a67697d701633dbf39f781d071a6a81486248129d736cf07022\": container with ID starting with 1f743f7264820a67697d701633dbf39f781d071a6a81486248129d736cf07022 not found: ID does not exist" containerID="1f743f7264820a67697d701633dbf39f781d071a6a81486248129d736cf07022" Jul 12 19:57:30.231631 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.231592 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f743f7264820a67697d701633dbf39f781d071a6a81486248129d736cf07022"} err="failed to get container status \"1f743f7264820a67697d701633dbf39f781d071a6a81486248129d736cf07022\": rpc error: code = NotFound desc = could not find container \"1f743f7264820a67697d701633dbf39f781d071a6a81486248129d736cf07022\": container with ID starting with 1f743f7264820a67697d701633dbf39f781d071a6a81486248129d736cf07022 not found: ID does not exist" Jul 12 19:57:30.231631 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.231609 2572 scope.go:117] "RemoveContainer" containerID="fbde18674570c70826f81ec0d86cfc7c00680fb11350f6c4e9c355b8dfbd134b" Jul 12 19:57:30.231812 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:57:30.231794 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbde18674570c70826f81ec0d86cfc7c00680fb11350f6c4e9c355b8dfbd134b\": container with ID starting with fbde18674570c70826f81ec0d86cfc7c00680fb11350f6c4e9c355b8dfbd134b not found: ID does not exist" containerID="fbde18674570c70826f81ec0d86cfc7c00680fb11350f6c4e9c355b8dfbd134b" Jul 12 19:57:30.231854 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.231818 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbde18674570c70826f81ec0d86cfc7c00680fb11350f6c4e9c355b8dfbd134b"} err="failed to get container status \"fbde18674570c70826f81ec0d86cfc7c00680fb11350f6c4e9c355b8dfbd134b\": rpc error: code = NotFound desc = could not find container \"fbde18674570c70826f81ec0d86cfc7c00680fb11350f6c4e9c355b8dfbd134b\": container with ID starting with fbde18674570c70826f81ec0d86cfc7c00680fb11350f6c4e9c355b8dfbd134b not found: ID does not exist" Jul 12 19:57:30.256948 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.256926 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-workload-certs\") pod \"6763e79e-280a-457a-9f81-601937833336\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " Jul 12 19:57:30.257062 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.256957 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-istio-data\") pod \"6763e79e-280a-457a-9f81-601937833336\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " Jul 12 19:57:30.257062 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.256999 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6763e79e-280a-457a-9f81-601937833336-istio-podinfo\") pod \"6763e79e-280a-457a-9f81-601937833336\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " Jul 12 19:57:30.257062 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.257041 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-credential-socket\") pod \"6763e79e-280a-457a-9f81-601937833336\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " Jul 12 19:57:30.257234 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.257087 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6763e79e-280a-457a-9f81-601937833336-istiod-ca-cert\") pod \"6763e79e-280a-457a-9f81-601937833336\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " Jul 12 19:57:30.257234 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.257127 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-workload-socket\") pod \"6763e79e-280a-457a-9f81-601937833336\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " Jul 12 19:57:30.257234 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.257148 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-istio-envoy\") pod \"6763e79e-280a-457a-9f81-601937833336\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " Jul 12 19:57:30.257234 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.257173 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6763e79e-280a-457a-9f81-601937833336-istio-token\") pod \"6763e79e-280a-457a-9f81-601937833336\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " Jul 12 19:57:30.257234 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.257177 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6763e79e-280a-457a-9f81-601937833336" (UID: "6763e79e-280a-457a-9f81-601937833336"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:57:30.257234 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.257217 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkwnb\" (UniqueName: \"kubernetes.io/projected/6763e79e-280a-457a-9f81-601937833336-kube-api-access-kkwnb\") pod \"6763e79e-280a-457a-9f81-601937833336\" (UID: \"6763e79e-280a-457a-9f81-601937833336\") " Jul 12 19:57:30.257559 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.257381 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6763e79e-280a-457a-9f81-601937833336" (UID: "6763e79e-280a-457a-9f81-601937833336"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:57:30.257559 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.257465 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6763e79e-280a-457a-9f81-601937833336" (UID: "6763e79e-280a-457a-9f81-601937833336"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:57:30.257660 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.257613 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-workload-certs\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:57:30.257660 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.257635 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-credential-socket\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:57:30.257660 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.257650 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-workload-socket\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:57:30.257804 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.257748 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6763e79e-280a-457a-9f81-601937833336-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6763e79e-280a-457a-9f81-601937833336" (UID: "6763e79e-280a-457a-9f81-601937833336"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:57:30.257999 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.257978 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-istio-data" (OuterVolumeSpecName: "istio-data") pod "6763e79e-280a-457a-9f81-601937833336" (UID: "6763e79e-280a-457a-9f81-601937833336"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:57:30.259478 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.259448 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6763e79e-280a-457a-9f81-601937833336-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6763e79e-280a-457a-9f81-601937833336" (UID: "6763e79e-280a-457a-9f81-601937833336"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 12 19:57:30.259613 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.259591 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6763e79e-280a-457a-9f81-601937833336-kube-api-access-kkwnb" (OuterVolumeSpecName: "kube-api-access-kkwnb") pod "6763e79e-280a-457a-9f81-601937833336" (UID: "6763e79e-280a-457a-9f81-601937833336"). InnerVolumeSpecName "kube-api-access-kkwnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:57:30.259776 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.259750 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6763e79e-280a-457a-9f81-601937833336-istio-token" (OuterVolumeSpecName: "istio-token") pod "6763e79e-280a-457a-9f81-601937833336" (UID: "6763e79e-280a-457a-9f81-601937833336"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:57:30.259776 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.259752 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6763e79e-280a-457a-9f81-601937833336" (UID: "6763e79e-280a-457a-9f81-601937833336"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:57:30.358619 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.358568 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6763e79e-280a-457a-9f81-601937833336-istiod-ca-cert\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:57:30.358619 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.358607 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-istio-envoy\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:57:30.358619 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.358623 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6763e79e-280a-457a-9f81-601937833336-istio-token\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:57:30.358619 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.358633 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkwnb\" (UniqueName: \"kubernetes.io/projected/6763e79e-280a-457a-9f81-601937833336-kube-api-access-kkwnb\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:57:30.358880 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.358642 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6763e79e-280a-457a-9f81-601937833336-istio-data\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:57:30.358880 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.358650 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6763e79e-280a-457a-9f81-601937833336-istio-podinfo\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:57:30.537020 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.536992 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm"] Jul 12 19:57:30.544402 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:30.544373 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-1f14a4-openshift-default-5ff85dd877-p4kpm"] Jul 12 19:57:31.012140 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:31.012111 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6763e79e-280a-457a-9f81-601937833336" path="/var/lib/kubelet/pods/6763e79e-280a-457a-9f81-601937833336/volumes" Jul 12 19:57:43.206530 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:43.206492 2572 patch_prober.go:28] interesting pod/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 12 19:57:43.206952 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:43.206586 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" podUID="c5667084-fec4-4f09-971f-0d66cf36ef5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 12 19:57:43.283045 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:43.283011 2572 generic.go:356] "Generic (PLEG): container finished" podID="c5667084-fec4-4f09-971f-0d66cf36ef5c" containerID="ef697b7d8bad2973e83a2c10991d74250ddf0272d3981ba382b0248c80e6b9c6" exitCode=0 Jul 12 19:57:43.283212 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:43.283089 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" event={"ID":"c5667084-fec4-4f09-971f-0d66cf36ef5c","Type":"ContainerDied","Data":"ef697b7d8bad2973e83a2c10991d74250ddf0272d3981ba382b0248c80e6b9c6"} Jul 12 19:57:43.283528 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:43.283510 2572 scope.go:117] "RemoveContainer" containerID="ef697b7d8bad2973e83a2c10991d74250ddf0272d3981ba382b0248c80e6b9c6" Jul 12 19:57:43.284508 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:43.284481 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:57:43.284619 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:43.284547 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:57:43.284619 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:43.284578 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:57:44.290169 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:44.290128 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" event={"ID":"c5667084-fec4-4f09-971f-0d66cf36ef5c","Type":"ContainerStarted","Data":"b1edb3d8f49818414cf85a4519c7e6cb7276775cfcf2b2e4a802ceea9dba0c13"} Jul 12 19:57:45.018357 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:45.018323 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:45.018653 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:45.018623 2572 patch_prober.go:28] interesting pod/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 12 19:57:45.018739 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:45.018685 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" podUID="c5667084-fec4-4f09-971f-0d66cf36ef5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 12 19:57:46.017870 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:46.017824 2572 patch_prober.go:28] interesting pod/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 12 19:57:46.018403 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:46.017893 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" podUID="c5667084-fec4-4f09-971f-0d66cf36ef5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 12 19:57:47.018613 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:47.018577 2572 patch_prober.go:28] interesting pod/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 12 19:57:47.019204 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:47.019172 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" podUID="c5667084-fec4-4f09-971f-0d66cf36ef5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 12 19:57:48.018343 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:48.018272 2572 patch_prober.go:28] interesting pod/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 12 19:57:48.018562 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:48.018381 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" podUID="c5667084-fec4-4f09-971f-0d66cf36ef5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 12 19:57:49.022045 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:49.022016 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:49.022419 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:49.022254 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:49.022975 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:49.022957 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:57:56.336624 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:56.336585 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf"] Jul 12 19:57:56.337094 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:57:56.336862 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" podUID="c5667084-fec4-4f09-971f-0d66cf36ef5c" containerName="istio-proxy" containerID="cri-o://b1edb3d8f49818414cf85a4519c7e6cb7276775cfcf2b2e4a802ceea9dba0c13" gracePeriod=30 Jul 12 19:58:01.593737 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.593713 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:58:01.656491 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.656461 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpsfq\" (UniqueName: \"kubernetes.io/projected/c5667084-fec4-4f09-971f-0d66cf36ef5c-kube-api-access-fpsfq\") pod \"c5667084-fec4-4f09-971f-0d66cf36ef5c\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " Jul 12 19:58:01.656629 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.656544 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-podinfo\") pod \"c5667084-fec4-4f09-971f-0d66cf36ef5c\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " Jul 12 19:58:01.656629 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.656596 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-workload-certs\") pod \"c5667084-fec4-4f09-971f-0d66cf36ef5c\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " Jul 12 19:58:01.656629 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.656612 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-credential-socket\") pod \"c5667084-fec4-4f09-971f-0d66cf36ef5c\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " Jul 12 19:58:01.656810 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.656630 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5667084-fec4-4f09-971f-0d66cf36ef5c-istiod-ca-cert\") pod \"c5667084-fec4-4f09-971f-0d66cf36ef5c\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " Jul 12 19:58:01.656810 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.656652 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-envoy\") pod \"c5667084-fec4-4f09-971f-0d66cf36ef5c\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " Jul 12 19:58:01.656810 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.656719 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-data\") pod \"c5667084-fec4-4f09-971f-0d66cf36ef5c\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " Jul 12 19:58:01.656810 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.656768 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-workload-socket\") pod \"c5667084-fec4-4f09-971f-0d66cf36ef5c\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " Jul 12 19:58:01.656997 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.656828 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-token\") pod \"c5667084-fec4-4f09-971f-0d66cf36ef5c\" (UID: \"c5667084-fec4-4f09-971f-0d66cf36ef5c\") " Jul 12 19:58:01.656997 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.656886 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c5667084-fec4-4f09-971f-0d66cf36ef5c" (UID: "c5667084-fec4-4f09-971f-0d66cf36ef5c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:58:01.657204 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.657140 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-workload-certs\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:58:01.657204 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.657112 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c5667084-fec4-4f09-971f-0d66cf36ef5c" (UID: "c5667084-fec4-4f09-971f-0d66cf36ef5c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:58:01.657400 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.657215 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5667084-fec4-4f09-971f-0d66cf36ef5c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c5667084-fec4-4f09-971f-0d66cf36ef5c" (UID: "c5667084-fec4-4f09-971f-0d66cf36ef5c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:58:01.657400 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.657272 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c5667084-fec4-4f09-971f-0d66cf36ef5c" (UID: "c5667084-fec4-4f09-971f-0d66cf36ef5c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:58:01.657958 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.657927 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-data" (OuterVolumeSpecName: "istio-data") pod "c5667084-fec4-4f09-971f-0d66cf36ef5c" (UID: "c5667084-fec4-4f09-971f-0d66cf36ef5c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:58:01.658932 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.658902 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c5667084-fec4-4f09-971f-0d66cf36ef5c" (UID: "c5667084-fec4-4f09-971f-0d66cf36ef5c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 12 19:58:01.659037 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.658903 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5667084-fec4-4f09-971f-0d66cf36ef5c-kube-api-access-fpsfq" (OuterVolumeSpecName: "kube-api-access-fpsfq") pod "c5667084-fec4-4f09-971f-0d66cf36ef5c" (UID: "c5667084-fec4-4f09-971f-0d66cf36ef5c"). InnerVolumeSpecName "kube-api-access-fpsfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:58:01.659079 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.659048 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-token" (OuterVolumeSpecName: "istio-token") pod "c5667084-fec4-4f09-971f-0d66cf36ef5c" (UID: "c5667084-fec4-4f09-971f-0d66cf36ef5c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:58:01.659313 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.659270 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c5667084-fec4-4f09-971f-0d66cf36ef5c" (UID: "c5667084-fec4-4f09-971f-0d66cf36ef5c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:58:01.758628 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.758550 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-credential-socket\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:58:01.758628 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.758577 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5667084-fec4-4f09-971f-0d66cf36ef5c-istiod-ca-cert\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:58:01.758628 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.758586 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-envoy\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:58:01.758628 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.758594 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-data\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:58:01.758628 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.758601 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5667084-fec4-4f09-971f-0d66cf36ef5c-workload-socket\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:58:01.758628 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.758610 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-token\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:58:01.758628 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.758618 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpsfq\" (UniqueName: \"kubernetes.io/projected/c5667084-fec4-4f09-971f-0d66cf36ef5c-kube-api-access-fpsfq\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:58:01.758628 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:01.758625 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5667084-fec4-4f09-971f-0d66cf36ef5c-istio-podinfo\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 19:58:02.385614 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:02.385580 2572 generic.go:356] "Generic (PLEG): container finished" podID="c5667084-fec4-4f09-971f-0d66cf36ef5c" containerID="b1edb3d8f49818414cf85a4519c7e6cb7276775cfcf2b2e4a802ceea9dba0c13" exitCode=0 Jul 12 19:58:02.385808 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:02.385630 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" Jul 12 19:58:02.385808 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:02.385670 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" event={"ID":"c5667084-fec4-4f09-971f-0d66cf36ef5c","Type":"ContainerDied","Data":"b1edb3d8f49818414cf85a4519c7e6cb7276775cfcf2b2e4a802ceea9dba0c13"} Jul 12 19:58:02.385808 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:02.385723 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf" event={"ID":"c5667084-fec4-4f09-971f-0d66cf36ef5c","Type":"ContainerDied","Data":"7dc8f3cddcbe4f2a20d1d81373f4b958d14ddf4555fbad8406ee6deef122e20c"} Jul 12 19:58:02.385808 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:02.385748 2572 scope.go:117] "RemoveContainer" containerID="b1edb3d8f49818414cf85a4519c7e6cb7276775cfcf2b2e4a802ceea9dba0c13" Jul 12 19:58:02.395335 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:02.395316 2572 scope.go:117] "RemoveContainer" containerID="ef697b7d8bad2973e83a2c10991d74250ddf0272d3981ba382b0248c80e6b9c6" Jul 12 19:58:02.403523 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:02.403508 2572 scope.go:117] "RemoveContainer" containerID="b1edb3d8f49818414cf85a4519c7e6cb7276775cfcf2b2e4a802ceea9dba0c13" Jul 12 19:58:02.403781 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:58:02.403764 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1edb3d8f49818414cf85a4519c7e6cb7276775cfcf2b2e4a802ceea9dba0c13\": container with ID starting with b1edb3d8f49818414cf85a4519c7e6cb7276775cfcf2b2e4a802ceea9dba0c13 not found: ID does not exist" containerID="b1edb3d8f49818414cf85a4519c7e6cb7276775cfcf2b2e4a802ceea9dba0c13" Jul 12 19:58:02.403828 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:02.403792 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1edb3d8f49818414cf85a4519c7e6cb7276775cfcf2b2e4a802ceea9dba0c13"} err="failed to get container status \"b1edb3d8f49818414cf85a4519c7e6cb7276775cfcf2b2e4a802ceea9dba0c13\": rpc error: code = NotFound desc = could not find container \"b1edb3d8f49818414cf85a4519c7e6cb7276775cfcf2b2e4a802ceea9dba0c13\": container with ID starting with b1edb3d8f49818414cf85a4519c7e6cb7276775cfcf2b2e4a802ceea9dba0c13 not found: ID does not exist" Jul 12 19:58:02.403828 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:02.403810 2572 scope.go:117] "RemoveContainer" containerID="ef697b7d8bad2973e83a2c10991d74250ddf0272d3981ba382b0248c80e6b9c6" Jul 12 19:58:02.404036 ip-10-0-133-234 kubenswrapper[2572]: E0712 19:58:02.404019 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef697b7d8bad2973e83a2c10991d74250ddf0272d3981ba382b0248c80e6b9c6\": container with ID starting with ef697b7d8bad2973e83a2c10991d74250ddf0272d3981ba382b0248c80e6b9c6 not found: ID does not exist" containerID="ef697b7d8bad2973e83a2c10991d74250ddf0272d3981ba382b0248c80e6b9c6" Jul 12 19:58:02.404082 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:02.404043 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef697b7d8bad2973e83a2c10991d74250ddf0272d3981ba382b0248c80e6b9c6"} err="failed to get container status \"ef697b7d8bad2973e83a2c10991d74250ddf0272d3981ba382b0248c80e6b9c6\": rpc error: code = NotFound desc = could not find container \"ef697b7d8bad2973e83a2c10991d74250ddf0272d3981ba382b0248c80e6b9c6\": container with ID starting with ef697b7d8bad2973e83a2c10991d74250ddf0272d3981ba382b0248c80e6b9c6 not found: ID does not exist" Jul 12 19:58:02.407812 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:02.407789 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf"] Jul 12 19:58:02.409482 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:02.409461 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-39b82d-openshift-default-5488bb7bdc-sx7rf"] Jul 12 19:58:03.012114 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.012079 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5667084-fec4-4f09-971f-0d66cf36ef5c" path="/var/lib/kubelet/pods/c5667084-fec4-4f09-971f-0d66cf36ef5c/volumes" Jul 12 19:58:03.975504 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.975470 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg"] Jul 12 19:58:03.975926 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.975909 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5667084-fec4-4f09-971f-0d66cf36ef5c" containerName="istio-proxy" Jul 12 19:58:03.976022 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.975930 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5667084-fec4-4f09-971f-0d66cf36ef5c" containerName="istio-proxy" Jul 12 19:58:03.976022 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.975943 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5667084-fec4-4f09-971f-0d66cf36ef5c" containerName="istio-proxy" Jul 12 19:58:03.976022 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.975951 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5667084-fec4-4f09-971f-0d66cf36ef5c" containerName="istio-proxy" Jul 12 19:58:03.976022 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.975982 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6763e79e-280a-457a-9f81-601937833336" containerName="istio-proxy" Jul 12 19:58:03.976022 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.975990 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6763e79e-280a-457a-9f81-601937833336" containerName="istio-proxy" Jul 12 19:58:03.976022 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.975998 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6763e79e-280a-457a-9f81-601937833336" containerName="istio-proxy" Jul 12 19:58:03.976022 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.976006 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6763e79e-280a-457a-9f81-601937833336" containerName="istio-proxy" Jul 12 19:58:03.976419 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.976099 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6763e79e-280a-457a-9f81-601937833336" containerName="istio-proxy" Jul 12 19:58:03.976419 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.976112 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5667084-fec4-4f09-971f-0d66cf36ef5c" containerName="istio-proxy" Jul 12 19:58:03.976419 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.976123 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5667084-fec4-4f09-971f-0d66cf36ef5c" containerName="istio-proxy" Jul 12 19:58:03.980870 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.980848 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:03.983235 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.983218 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 12 19:58:03.983235 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.983231 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-dc7943-openshift-default-dockercfg-tfsz8\"" Jul 12 19:58:03.988493 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:03.988434 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg"] Jul 12 19:58:04.079656 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.079627 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-data\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.080065 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.079670 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-envoy\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.080065 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.079722 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-workload-certs\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.080065 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.079748 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n46cj\" (UniqueName: \"kubernetes.io/projected/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-kube-api-access-n46cj\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.080065 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.079797 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istiod-ca-cert\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.080065 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.079829 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-workload-socket\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.080065 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.079861 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-token\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.080065 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.079906 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-credential-socket\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.080065 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.079961 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-podinfo\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.181330 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.181272 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-data\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.181498 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.181356 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-envoy\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.181498 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.181413 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-workload-certs\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.181498 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.181438 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n46cj\" (UniqueName: \"kubernetes.io/projected/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-kube-api-access-n46cj\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.181498 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.181472 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istiod-ca-cert\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.181703 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.181500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-workload-socket\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.181703 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.181534 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-token\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.181703 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.181585 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-credential-socket\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.181703 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.181648 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-podinfo\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.181874 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.181725 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-data\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.182037 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.181996 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-workload-certs\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.182184 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.182146 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-workload-socket\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.182184 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.182171 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-credential-socket\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.182432 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.182415 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istiod-ca-cert\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.184558 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.184534 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-envoy\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.184687 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.184592 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-podinfo\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.189512 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.189489 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n46cj\" (UniqueName: \"kubernetes.io/projected/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-kube-api-access-n46cj\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.189638 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.189603 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-token\") pod \"e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.292808 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.292731 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:04.443360 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.443336 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg"] Jul 12 19:58:04.445927 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:58:04.445901 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea2839fd_26fa_47b7_b8b5_a1a37a533ab5.slice/crio-8f524bd9016f45c7118019385baaed37124693ad038ac98331b7e4bc706b1e40 WatchSource:0}: Error finding container 8f524bd9016f45c7118019385baaed37124693ad038ac98331b7e4bc706b1e40: Status 404 returned error can't find the container with id 8f524bd9016f45c7118019385baaed37124693ad038ac98331b7e4bc706b1e40 Jul 12 19:58:04.448531 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.448501 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:58:04.448610 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.448568 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:58:04.448610 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:04.448594 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:58:05.403759 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:05.403716 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" event={"ID":"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5","Type":"ContainerStarted","Data":"aea2ccfdc87b48a35089ddacd8e4eecd069555ca288a37ec70881a5652606d24"} Jul 12 19:58:05.404143 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:05.403814 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" event={"ID":"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5","Type":"ContainerStarted","Data":"8f524bd9016f45c7118019385baaed37124693ad038ac98331b7e4bc706b1e40"} Jul 12 19:58:05.423486 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:05.423434 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" podStartSLOduration=2.423420596 podStartE2EDuration="2.423420596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:58:05.422117959 +0000 UTC m=+2284.956106135" watchObservedRunningTime="2026-07-12 19:58:05.423420596 +0000 UTC m=+2284.957408773" Jul 12 19:58:06.293093 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:06.293059 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:06.297721 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:06.297694 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:06.408734 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:06.408707 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:06.409641 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:06.409620 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:12.337249 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.337215 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq"] Jul 12 19:58:12.337812 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.337793 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6763e79e-280a-457a-9f81-601937833336" containerName="istio-proxy" Jul 12 19:58:12.340599 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.340584 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.343243 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.343220 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-c62cfb-openshift-default-dockercfg-8drfx\"" Jul 12 19:58:12.352639 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.352613 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq"] Jul 12 19:58:12.466992 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.466954 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-data\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.466992 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.466994 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd778769-aa86-40c1-8214-d1a4ea3a9517-istiod-ca-cert\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.467214 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.467013 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-token\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.467214 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.467067 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-workload-certs\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.467214 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.467125 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-podinfo\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.467214 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.467170 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-envoy\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.467214 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.467194 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-workload-socket\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.467411 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.467227 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-credential-socket\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.467411 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.467266 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8dt2\" (UniqueName: \"kubernetes.io/projected/dd778769-aa86-40c1-8214-d1a4ea3a9517-kube-api-access-q8dt2\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.568628 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.568582 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8dt2\" (UniqueName: \"kubernetes.io/projected/dd778769-aa86-40c1-8214-d1a4ea3a9517-kube-api-access-q8dt2\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.568845 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.568687 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-data\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.568845 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.568715 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd778769-aa86-40c1-8214-d1a4ea3a9517-istiod-ca-cert\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.568845 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.568738 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-token\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.568845 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.568772 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-workload-certs\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.569082 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.568865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-podinfo\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.569082 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.568924 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-envoy\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.569082 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.568961 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-workload-socket\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.569082 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.569012 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-credential-socket\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.569325 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.569159 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-data\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.569325 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.569188 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-workload-certs\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.569325 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.569273 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-workload-socket\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.569477 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.569393 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-credential-socket\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.569635 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.569617 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd778769-aa86-40c1-8214-d1a4ea3a9517-istiod-ca-cert\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.571448 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.571419 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-envoy\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.571605 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.571590 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-podinfo\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.581866 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.581841 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-token\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.583522 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.583492 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8dt2\" (UniqueName: \"kubernetes.io/projected/dd778769-aa86-40c1-8214-d1a4ea3a9517-kube-api-access-q8dt2\") pod \"e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.652133 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.652093 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:12.794059 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.794036 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq"] Jul 12 19:58:12.795895 ip-10-0-133-234 kubenswrapper[2572]: W0712 19:58:12.795866 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd778769_aa86_40c1_8214_d1a4ea3a9517.slice/crio-d34a0ea7c5784a9fac57b10bcddaa56e25d32e52512bd79f35348e4e9aad3d04 WatchSource:0}: Error finding container d34a0ea7c5784a9fac57b10bcddaa56e25d32e52512bd79f35348e4e9aad3d04: Status 404 returned error can't find the container with id d34a0ea7c5784a9fac57b10bcddaa56e25d32e52512bd79f35348e4e9aad3d04 Jul 12 19:58:12.798196 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.798156 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:58:12.798272 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.798221 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:58:12.798272 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:12.798248 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:58:13.447725 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:13.447687 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" event={"ID":"dd778769-aa86-40c1-8214-d1a4ea3a9517","Type":"ContainerStarted","Data":"232d7f77199dc38a15d743994bfadd143e945185693a665c2c64754158e6f95c"} Jul 12 19:58:13.448173 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:13.447746 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" event={"ID":"dd778769-aa86-40c1-8214-d1a4ea3a9517","Type":"ContainerStarted","Data":"d34a0ea7c5784a9fac57b10bcddaa56e25d32e52512bd79f35348e4e9aad3d04"} Jul 12 19:58:13.469516 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:13.469468 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" podStartSLOduration=1.469452598 podStartE2EDuration="1.469452598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:58:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:58:13.468558164 +0000 UTC m=+2293.002546338" watchObservedRunningTime="2026-07-12 19:58:13.469452598 +0000 UTC m=+2293.003440773" Jul 12 19:58:13.652811 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:13.652772 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:13.657164 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:13.657140 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:14.453248 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:14.453221 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:14.454263 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:14.454244 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:22.450486 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:22.450437 2572 patch_prober.go:28] interesting pod/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 12 19:58:22.450878 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:22.450504 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" podUID="ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 12 19:58:23.509049 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:23.508994 2572 generic.go:356] "Generic (PLEG): container finished" podID="ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" containerID="aea2ccfdc87b48a35089ddacd8e4eecd069555ca288a37ec70881a5652606d24" exitCode=0 Jul 12 19:58:23.509606 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:23.509076 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" event={"ID":"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5","Type":"ContainerDied","Data":"aea2ccfdc87b48a35089ddacd8e4eecd069555ca288a37ec70881a5652606d24"} Jul 12 19:58:23.509677 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:23.509615 2572 scope.go:117] "RemoveContainer" containerID="aea2ccfdc87b48a35089ddacd8e4eecd069555ca288a37ec70881a5652606d24" Jul 12 19:58:23.510951 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:23.510911 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:58:23.511115 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:23.511005 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:58:23.511115 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:23.511052 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:58:24.519928 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:24.519884 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" event={"ID":"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5","Type":"ContainerStarted","Data":"8ffe444a81f84ac1923407e541624685e79eb514b86a51a180ff3fdf8fc5ab96"} Jul 12 19:58:25.293593 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:25.293557 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:25.293788 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:25.293762 2572 patch_prober.go:28] interesting pod/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 12 19:58:25.293839 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:25.293810 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" podUID="ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 12 19:58:26.293893 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:26.293860 2572 patch_prober.go:28] interesting pod/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 12 19:58:26.294327 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:26.293914 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" podUID="ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 12 19:58:27.293373 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:27.293335 2572 patch_prober.go:28] interesting pod/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 12 19:58:27.293556 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:27.293392 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" podUID="ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 12 19:58:28.293943 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:28.293908 2572 patch_prober.go:28] interesting pod/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 12 19:58:28.294400 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:28.293966 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" podUID="ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 12 19:58:29.297132 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:29.297100 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:29.297613 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:29.297447 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:29.298246 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:29.298227 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 19:58:29.842689 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:29.841967 2572 patch_prober.go:28] interesting pod/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": read tcp 10.133.0.2:59966->10.133.0.45:15021: read: connection reset by peer" start-of-body= Jul 12 19:58:29.842689 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:29.842138 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" podUID="dd778769-aa86-40c1-8214-d1a4ea3a9517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": read tcp 10.133.0.2:59966->10.133.0.45:15021: read: connection reset by peer" Jul 12 19:58:30.557800 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:30.557767 2572 generic.go:356] "Generic (PLEG): container finished" podID="dd778769-aa86-40c1-8214-d1a4ea3a9517" containerID="232d7f77199dc38a15d743994bfadd143e945185693a665c2c64754158e6f95c" exitCode=0 Jul 12 19:58:30.558207 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:30.557843 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" event={"ID":"dd778769-aa86-40c1-8214-d1a4ea3a9517","Type":"ContainerDied","Data":"232d7f77199dc38a15d743994bfadd143e945185693a665c2c64754158e6f95c"} Jul 12 19:58:30.558389 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:30.558373 2572 scope.go:117] "RemoveContainer" containerID="232d7f77199dc38a15d743994bfadd143e945185693a665c2c64754158e6f95c" Jul 12 19:58:30.559315 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:30.559274 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:58:30.559436 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:30.559354 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:58:30.559436 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:30.559387 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 19:58:31.563793 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:31.563762 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" event={"ID":"dd778769-aa86-40c1-8214-d1a4ea3a9517","Type":"ContainerStarted","Data":"668d646369e6986b8b4b36277b8e21631e1a05952d2ab6de0de03c36ed4ce2c0"} Jul 12 19:58:31.652985 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:31.652950 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:31.653170 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:31.653100 2572 patch_prober.go:28] interesting pod/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 12 19:58:31.653170 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:31.653151 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" podUID="dd778769-aa86-40c1-8214-d1a4ea3a9517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 12 19:58:32.652829 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:32.652791 2572 patch_prober.go:28] interesting pod/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 12 19:58:32.653244 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:32.652853 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" podUID="dd778769-aa86-40c1-8214-d1a4ea3a9517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 12 19:58:33.653003 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:33.652964 2572 patch_prober.go:28] interesting pod/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 12 19:58:33.653446 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:33.653035 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" podUID="dd778769-aa86-40c1-8214-d1a4ea3a9517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 12 19:58:34.653099 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:34.653060 2572 patch_prober.go:28] interesting pod/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 12 19:58:34.653588 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:34.653122 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" podUID="dd778769-aa86-40c1-8214-d1a4ea3a9517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 12 19:58:35.652623 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:35.652593 2572 patch_prober.go:28] interesting pod/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 12 19:58:35.652797 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:35.652655 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" podUID="dd778769-aa86-40c1-8214-d1a4ea3a9517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 12 19:58:36.656942 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:36.656908 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:36.657355 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:36.657258 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 19:58:36.657996 ip-10-0-133-234 kubenswrapper[2572]: I0712 19:58:36.657978 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 20:01:31.200721 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:31.200683 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg"] Jul 12 20:01:31.201232 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:31.200924 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" podUID="ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" containerName="istio-proxy" containerID="cri-o://8ffe444a81f84ac1923407e541624685e79eb514b86a51a180ff3fdf8fc5ab96" gracePeriod=30 Jul 12 20:01:36.453336 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.453309 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 20:01:36.458852 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.458827 2572 generic.go:356] "Generic (PLEG): container finished" podID="ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" containerID="8ffe444a81f84ac1923407e541624685e79eb514b86a51a180ff3fdf8fc5ab96" exitCode=0 Jul 12 20:01:36.458968 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.458870 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" Jul 12 20:01:36.458968 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.458907 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" event={"ID":"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5","Type":"ContainerDied","Data":"8ffe444a81f84ac1923407e541624685e79eb514b86a51a180ff3fdf8fc5ab96"} Jul 12 20:01:36.458968 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.458959 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg" event={"ID":"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5","Type":"ContainerDied","Data":"8f524bd9016f45c7118019385baaed37124693ad038ac98331b7e4bc706b1e40"} Jul 12 20:01:36.459116 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.458981 2572 scope.go:117] "RemoveContainer" containerID="8ffe444a81f84ac1923407e541624685e79eb514b86a51a180ff3fdf8fc5ab96" Jul 12 20:01:36.467515 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.467495 2572 scope.go:117] "RemoveContainer" containerID="aea2ccfdc87b48a35089ddacd8e4eecd069555ca288a37ec70881a5652606d24" Jul 12 20:01:36.476598 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.476574 2572 scope.go:117] "RemoveContainer" containerID="8ffe444a81f84ac1923407e541624685e79eb514b86a51a180ff3fdf8fc5ab96" Jul 12 20:01:36.476904 ip-10-0-133-234 kubenswrapper[2572]: E0712 20:01:36.476877 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ffe444a81f84ac1923407e541624685e79eb514b86a51a180ff3fdf8fc5ab96\": container with ID starting with 8ffe444a81f84ac1923407e541624685e79eb514b86a51a180ff3fdf8fc5ab96 not found: ID does not exist" containerID="8ffe444a81f84ac1923407e541624685e79eb514b86a51a180ff3fdf8fc5ab96" Jul 12 20:01:36.477001 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.476915 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ffe444a81f84ac1923407e541624685e79eb514b86a51a180ff3fdf8fc5ab96"} err="failed to get container status \"8ffe444a81f84ac1923407e541624685e79eb514b86a51a180ff3fdf8fc5ab96\": rpc error: code = NotFound desc = could not find container \"8ffe444a81f84ac1923407e541624685e79eb514b86a51a180ff3fdf8fc5ab96\": container with ID starting with 8ffe444a81f84ac1923407e541624685e79eb514b86a51a180ff3fdf8fc5ab96 not found: ID does not exist" Jul 12 20:01:36.477001 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.476933 2572 scope.go:117] "RemoveContainer" containerID="aea2ccfdc87b48a35089ddacd8e4eecd069555ca288a37ec70881a5652606d24" Jul 12 20:01:36.477216 ip-10-0-133-234 kubenswrapper[2572]: E0712 20:01:36.477202 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aea2ccfdc87b48a35089ddacd8e4eecd069555ca288a37ec70881a5652606d24\": container with ID starting with aea2ccfdc87b48a35089ddacd8e4eecd069555ca288a37ec70881a5652606d24 not found: ID does not exist" containerID="aea2ccfdc87b48a35089ddacd8e4eecd069555ca288a37ec70881a5652606d24" Jul 12 20:01:36.477265 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.477221 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aea2ccfdc87b48a35089ddacd8e4eecd069555ca288a37ec70881a5652606d24"} err="failed to get container status \"aea2ccfdc87b48a35089ddacd8e4eecd069555ca288a37ec70881a5652606d24\": rpc error: code = NotFound desc = could not find container \"aea2ccfdc87b48a35089ddacd8e4eecd069555ca288a37ec70881a5652606d24\": container with ID starting with aea2ccfdc87b48a35089ddacd8e4eecd069555ca288a37ec70881a5652606d24 not found: ID does not exist" Jul 12 20:01:36.558780 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.558755 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n46cj\" (UniqueName: \"kubernetes.io/projected/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-kube-api-access-n46cj\") pod \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " Jul 12 20:01:36.558955 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.558792 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-credential-socket\") pod \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " Jul 12 20:01:36.558955 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.558844 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-workload-socket\") pod \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " Jul 12 20:01:36.559091 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.558958 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-envoy\") pod \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " Jul 12 20:01:36.559091 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.559032 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-data\") pod \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " Jul 12 20:01:36.559091 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.559058 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-workload-certs\") pod \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " Jul 12 20:01:36.559091 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.559059 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" (UID: "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 20:01:36.559326 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.559133 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istiod-ca-cert\") pod \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " Jul 12 20:01:36.559326 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.559129 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" (UID: "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 20:01:36.559326 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.559174 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-token\") pod \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " Jul 12 20:01:36.559326 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.559211 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-podinfo\") pod \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\" (UID: \"ea2839fd-26fa-47b7-b8b5-a1a37a533ab5\") " Jul 12 20:01:36.559533 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.559391 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" (UID: "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 20:01:36.559533 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.559499 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" (UID: "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 20:01:36.559664 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.559643 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istiod-ca-cert\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:36.559714 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.559669 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-credential-socket\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:36.559714 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.559684 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-workload-socket\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:36.559714 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.559697 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-workload-certs\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:36.559980 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.559916 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" (UID: "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 20:01:36.561525 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.561502 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-kube-api-access-n46cj" (OuterVolumeSpecName: "kube-api-access-n46cj") pod "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" (UID: "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5"). InnerVolumeSpecName "kube-api-access-n46cj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 20:01:36.561525 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.561510 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" (UID: "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 12 20:01:36.561726 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.561707 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" (UID: "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 20:01:36.561792 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.561775 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" (UID: "ea2839fd-26fa-47b7-b8b5-a1a37a533ab5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 20:01:36.660785 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.660752 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-token\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:36.660785 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.660778 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-podinfo\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:36.660785 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.660788 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n46cj\" (UniqueName: \"kubernetes.io/projected/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-kube-api-access-n46cj\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:36.661029 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.660800 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-envoy\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:36.661029 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.660809 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5-istio-data\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:36.780611 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.780579 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg"] Jul 12 20:01:36.783496 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:36.783471 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-dc7943-openshift-default-6bc6585d75-chhgg"] Jul 12 20:01:37.011305 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:37.011252 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" path="/var/lib/kubelet/pods/ea2839fd-26fa-47b7-b8b5-a1a37a533ab5/volumes" Jul 12 20:01:37.752242 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:37.752210 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq"] Jul 12 20:01:37.752677 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:37.752528 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" podUID="dd778769-aa86-40c1-8214-d1a4ea3a9517" containerName="istio-proxy" containerID="cri-o://668d646369e6986b8b4b36277b8e21631e1a05952d2ab6de0de03c36ed4ce2c0" gracePeriod=30 Jul 12 20:01:43.003895 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.003866 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 20:01:43.105382 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.105305 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5699dc8655-799lh_ae83e1af-89de-4146-b98d-4fa4ea6001fb/manager/0.log" Jul 12 20:01:43.119511 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.119484 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-envoy\") pod \"dd778769-aa86-40c1-8214-d1a4ea3a9517\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " Jul 12 20:01:43.119652 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.119531 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-token\") pod \"dd778769-aa86-40c1-8214-d1a4ea3a9517\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " Jul 12 20:01:43.119652 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.119574 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-workload-socket\") pod \"dd778769-aa86-40c1-8214-d1a4ea3a9517\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " Jul 12 20:01:43.119652 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.119602 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-workload-certs\") pod \"dd778769-aa86-40c1-8214-d1a4ea3a9517\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " Jul 12 20:01:43.119652 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.119622 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-data\") pod \"dd778769-aa86-40c1-8214-d1a4ea3a9517\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " Jul 12 20:01:43.119829 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.119710 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd778769-aa86-40c1-8214-d1a4ea3a9517-istiod-ca-cert\") pod \"dd778769-aa86-40c1-8214-d1a4ea3a9517\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " Jul 12 20:01:43.119829 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.119745 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8dt2\" (UniqueName: \"kubernetes.io/projected/dd778769-aa86-40c1-8214-d1a4ea3a9517-kube-api-access-q8dt2\") pod \"dd778769-aa86-40c1-8214-d1a4ea3a9517\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " Jul 12 20:01:43.119829 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.119786 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-podinfo\") pod \"dd778769-aa86-40c1-8214-d1a4ea3a9517\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " Jul 12 20:01:43.120042 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.119825 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd778769-aa86-40c1-8214-d1a4ea3a9517" (UID: "dd778769-aa86-40c1-8214-d1a4ea3a9517"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 20:01:43.120042 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.119840 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-credential-socket\") pod \"dd778769-aa86-40c1-8214-d1a4ea3a9517\" (UID: \"dd778769-aa86-40c1-8214-d1a4ea3a9517\") " Jul 12 20:01:43.120042 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.119918 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd778769-aa86-40c1-8214-d1a4ea3a9517" (UID: "dd778769-aa86-40c1-8214-d1a4ea3a9517"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 20:01:43.120205 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.120040 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd778769-aa86-40c1-8214-d1a4ea3a9517" (UID: "dd778769-aa86-40c1-8214-d1a4ea3a9517"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 20:01:43.120205 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.120094 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd778769-aa86-40c1-8214-d1a4ea3a9517-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd778769-aa86-40c1-8214-d1a4ea3a9517" (UID: "dd778769-aa86-40c1-8214-d1a4ea3a9517"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 20:01:43.120384 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.120357 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-workload-certs\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:43.120461 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.120383 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd778769-aa86-40c1-8214-d1a4ea3a9517-istiod-ca-cert\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:43.120461 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.120396 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-credential-socket\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:43.120461 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.120408 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-workload-socket\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:43.120614 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.120564 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd778769-aa86-40c1-8214-d1a4ea3a9517" (UID: "dd778769-aa86-40c1-8214-d1a4ea3a9517"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 20:01:43.121898 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.121879 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd778769-aa86-40c1-8214-d1a4ea3a9517" (UID: "dd778769-aa86-40c1-8214-d1a4ea3a9517"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 20:01:43.122206 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.122190 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd778769-aa86-40c1-8214-d1a4ea3a9517" (UID: "dd778769-aa86-40c1-8214-d1a4ea3a9517"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 20:01:43.122482 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.122462 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd778769-aa86-40c1-8214-d1a4ea3a9517" (UID: "dd778769-aa86-40c1-8214-d1a4ea3a9517"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 12 20:01:43.122545 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.122489 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd778769-aa86-40c1-8214-d1a4ea3a9517-kube-api-access-q8dt2" (OuterVolumeSpecName: "kube-api-access-q8dt2") pod "dd778769-aa86-40c1-8214-d1a4ea3a9517" (UID: "dd778769-aa86-40c1-8214-d1a4ea3a9517"). InnerVolumeSpecName "kube-api-access-q8dt2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 20:01:43.221350 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.221313 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-envoy\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:43.221350 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.221346 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-token\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:43.221350 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.221358 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-data\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:43.221586 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.221370 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8dt2\" (UniqueName: \"kubernetes.io/projected/dd778769-aa86-40c1-8214-d1a4ea3a9517-kube-api-access-q8dt2\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:43.221586 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.221382 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd778769-aa86-40c1-8214-d1a4ea3a9517-istio-podinfo\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jul 12 20:01:43.442053 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.442025 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68dff8c9d6-7hx4s_6553d1e0-17a1-4dfe-9ce1-4944940146d6/copy-manifests/0.log" Jul 12 20:01:43.448252 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.448227 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68dff8c9d6-7hx4s_6553d1e0-17a1-4dfe-9ce1-4944940146d6/manager/0.log" Jul 12 20:01:43.497546 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.497518 2572 generic.go:356] "Generic (PLEG): container finished" podID="dd778769-aa86-40c1-8214-d1a4ea3a9517" containerID="668d646369e6986b8b4b36277b8e21631e1a05952d2ab6de0de03c36ed4ce2c0" exitCode=0 Jul 12 20:01:43.497687 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.497563 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" Jul 12 20:01:43.497687 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.497598 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" event={"ID":"dd778769-aa86-40c1-8214-d1a4ea3a9517","Type":"ContainerDied","Data":"668d646369e6986b8b4b36277b8e21631e1a05952d2ab6de0de03c36ed4ce2c0"} Jul 12 20:01:43.497687 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.497650 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq" event={"ID":"dd778769-aa86-40c1-8214-d1a4ea3a9517","Type":"ContainerDied","Data":"d34a0ea7c5784a9fac57b10bcddaa56e25d32e52512bd79f35348e4e9aad3d04"} Jul 12 20:01:43.497687 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.497677 2572 scope.go:117] "RemoveContainer" containerID="668d646369e6986b8b4b36277b8e21631e1a05952d2ab6de0de03c36ed4ce2c0" Jul 12 20:01:43.507120 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.507104 2572 scope.go:117] "RemoveContainer" containerID="232d7f77199dc38a15d743994bfadd143e945185693a665c2c64754158e6f95c" Jul 12 20:01:43.514995 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.514979 2572 scope.go:117] "RemoveContainer" containerID="668d646369e6986b8b4b36277b8e21631e1a05952d2ab6de0de03c36ed4ce2c0" Jul 12 20:01:43.515252 ip-10-0-133-234 kubenswrapper[2572]: E0712 20:01:43.515235 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"668d646369e6986b8b4b36277b8e21631e1a05952d2ab6de0de03c36ed4ce2c0\": container with ID starting with 668d646369e6986b8b4b36277b8e21631e1a05952d2ab6de0de03c36ed4ce2c0 not found: ID does not exist" containerID="668d646369e6986b8b4b36277b8e21631e1a05952d2ab6de0de03c36ed4ce2c0" Jul 12 20:01:43.515341 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.515260 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"668d646369e6986b8b4b36277b8e21631e1a05952d2ab6de0de03c36ed4ce2c0"} err="failed to get container status \"668d646369e6986b8b4b36277b8e21631e1a05952d2ab6de0de03c36ed4ce2c0\": rpc error: code = NotFound desc = could not find container \"668d646369e6986b8b4b36277b8e21631e1a05952d2ab6de0de03c36ed4ce2c0\": container with ID starting with 668d646369e6986b8b4b36277b8e21631e1a05952d2ab6de0de03c36ed4ce2c0 not found: ID does not exist" Jul 12 20:01:43.515341 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.515277 2572 scope.go:117] "RemoveContainer" containerID="232d7f77199dc38a15d743994bfadd143e945185693a665c2c64754158e6f95c" Jul 12 20:01:43.515545 ip-10-0-133-234 kubenswrapper[2572]: E0712 20:01:43.515529 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"232d7f77199dc38a15d743994bfadd143e945185693a665c2c64754158e6f95c\": container with ID starting with 232d7f77199dc38a15d743994bfadd143e945185693a665c2c64754158e6f95c not found: ID does not exist" containerID="232d7f77199dc38a15d743994bfadd143e945185693a665c2c64754158e6f95c" Jul 12 20:01:43.515582 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.515553 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"232d7f77199dc38a15d743994bfadd143e945185693a665c2c64754158e6f95c"} err="failed to get container status \"232d7f77199dc38a15d743994bfadd143e945185693a665c2c64754158e6f95c\": rpc error: code = NotFound desc = could not find container \"232d7f77199dc38a15d743994bfadd143e945185693a665c2c64754158e6f95c\": container with ID starting with 232d7f77199dc38a15d743994bfadd143e945185693a665c2c64754158e6f95c not found: ID does not exist" Jul 12 20:01:43.518690 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.518668 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq"] Jul 12 20:01:43.522372 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:43.522354 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-c62cfb-openshift-default-55f7bb799f-lzvcq"] Jul 12 20:01:45.013217 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:45.013175 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd778769-aa86-40c1-8214-d1a4ea3a9517" path="/var/lib/kubelet/pods/dd778769-aa86-40c1-8214-d1a4ea3a9517/volumes" Jul 12 20:01:46.289877 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:46.289846 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59ff7fb449-4g9pw_aa049892-e6e1-434d-ac2e-79e45bd343ac/kube-auth-proxy/0.log" Jul 12 20:01:46.636256 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:46.636221 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8jh7k_a2345147-f773-4400-a90c-e1e629330adb/payload-pre-processing/0.log" Jul 12 20:01:47.192474 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:47.192448 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-6c2d6_017ef789-5a05-4772-bb38-b4bc767a70ce/main/0.log" Jul 12 20:01:47.513489 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:47.513410 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7wpnx_92f9901d-6ec2-422f-b1f4-8ccff9a289e5/main/0.log" Jul 12 20:01:47.623920 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:47.623891 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-prfsv_6111d801-e5a1-4206-a08e-cb5c539a0cc7/main/0.log" Jul 12 20:01:54.878619 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:54.878536 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5pzz7_2c56f312-5f0b-47d4-a4be-1a366e433488/global-pull-secret-syncer/0.log" Jul 12 20:01:55.067073 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:55.067048 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rsf7p_e895d844-4f9c-47d9-ae8b-de587d04c049/konnectivity-agent/0.log" Jul 12 20:01:55.132004 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:01:55.131903 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-234.ec2.internal_2df761e96899302463c4ca9d4dd2ee01/haproxy/0.log" Jul 12 20:02:02.119927 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.119891 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bed0b78a-3dbc-4d82-9035-0c8ccbc43e54/alertmanager/0.log" Jul 12 20:02:02.141002 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.140973 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bed0b78a-3dbc-4d82-9035-0c8ccbc43e54/config-reloader/0.log" Jul 12 20:02:02.163102 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.163078 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bed0b78a-3dbc-4d82-9035-0c8ccbc43e54/kube-rbac-proxy-web/0.log" Jul 12 20:02:02.185311 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.185266 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bed0b78a-3dbc-4d82-9035-0c8ccbc43e54/kube-rbac-proxy/0.log" Jul 12 20:02:02.205130 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.205106 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bed0b78a-3dbc-4d82-9035-0c8ccbc43e54/kube-rbac-proxy-metric/0.log" Jul 12 20:02:02.223927 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.223895 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bed0b78a-3dbc-4d82-9035-0c8ccbc43e54/prom-label-proxy/0.log" Jul 12 20:02:02.244917 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.244889 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bed0b78a-3dbc-4d82-9035-0c8ccbc43e54/init-config-reloader/0.log" Jul 12 20:02:02.282497 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.282437 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-t92kk_30f415e8-a1ee-40c8-972b-c88fe2d30530/cluster-monitoring-operator/0.log" Jul 12 20:02:02.375189 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.375156 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-58b55fb974-skzwp_74231b74-f63a-4f29-abaa-3f8dd66adb0f/metrics-server/0.log" Jul 12 20:02:02.632763 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.632733 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gbtrg_26508366-f163-4cfe-ba39-c05a41514d49/node-exporter/0.log" Jul 12 20:02:02.654476 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.654444 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gbtrg_26508366-f163-4cfe-ba39-c05a41514d49/kube-rbac-proxy/0.log" Jul 12 20:02:02.676091 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.676066 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gbtrg_26508366-f163-4cfe-ba39-c05a41514d49/init-textfile/0.log" Jul 12 20:02:02.799431 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.799406 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a51a8b4d-cbe3-4dc3-b804-02d029ea7f73/prometheus/0.log" Jul 12 20:02:02.818821 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.818794 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a51a8b4d-cbe3-4dc3-b804-02d029ea7f73/config-reloader/0.log" Jul 12 20:02:02.838454 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.838430 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a51a8b4d-cbe3-4dc3-b804-02d029ea7f73/thanos-sidecar/0.log" Jul 12 20:02:02.858209 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.858185 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a51a8b4d-cbe3-4dc3-b804-02d029ea7f73/kube-rbac-proxy-web/0.log" Jul 12 20:02:02.884697 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.884630 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a51a8b4d-cbe3-4dc3-b804-02d029ea7f73/kube-rbac-proxy/0.log" Jul 12 20:02:02.903279 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.903259 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a51a8b4d-cbe3-4dc3-b804-02d029ea7f73/kube-rbac-proxy-thanos/0.log" Jul 12 20:02:02.922515 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.922498 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a51a8b4d-cbe3-4dc3-b804-02d029ea7f73/init-config-reloader/0.log" Jul 12 20:02:02.992341 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:02.992315 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-wg8md_ae0a81c9-62bb-4970-8852-f86cf010b72f/prometheus-operator-admission-webhook/0.log" Jul 12 20:02:03.094621 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:03.094595 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55bdcc978c-bvmp2_c451349d-c041-43ff-ac0c-8ebfc14b8594/thanos-query/0.log" Jul 12 20:02:03.115377 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:03.115354 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55bdcc978c-bvmp2_c451349d-c041-43ff-ac0c-8ebfc14b8594/kube-rbac-proxy-web/0.log" Jul 12 20:02:03.134458 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:03.134437 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55bdcc978c-bvmp2_c451349d-c041-43ff-ac0c-8ebfc14b8594/kube-rbac-proxy/0.log" Jul 12 20:02:03.153475 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:03.153411 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55bdcc978c-bvmp2_c451349d-c041-43ff-ac0c-8ebfc14b8594/prom-label-proxy/0.log" Jul 12 20:02:03.176663 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:03.176646 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55bdcc978c-bvmp2_c451349d-c041-43ff-ac0c-8ebfc14b8594/kube-rbac-proxy-rules/0.log" Jul 12 20:02:03.195990 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:03.195970 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55bdcc978c-bvmp2_c451349d-c041-43ff-ac0c-8ebfc14b8594/kube-rbac-proxy-metrics/0.log" Jul 12 20:02:05.373524 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.373486 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf"] Jul 12 20:02:05.374079 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.374058 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" containerName="istio-proxy" Jul 12 20:02:05.374166 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.374082 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" containerName="istio-proxy" Jul 12 20:02:05.374166 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.374095 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd778769-aa86-40c1-8214-d1a4ea3a9517" containerName="istio-proxy" Jul 12 20:02:05.374166 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.374102 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd778769-aa86-40c1-8214-d1a4ea3a9517" containerName="istio-proxy" Jul 12 20:02:05.374166 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.374132 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" containerName="istio-proxy" Jul 12 20:02:05.374166 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.374141 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" containerName="istio-proxy" Jul 12 20:02:05.374166 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.374154 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd778769-aa86-40c1-8214-d1a4ea3a9517" containerName="istio-proxy" Jul 12 20:02:05.374166 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.374163 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd778769-aa86-40c1-8214-d1a4ea3a9517" containerName="istio-proxy" Jul 12 20:02:05.374560 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.374264 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd778769-aa86-40c1-8214-d1a4ea3a9517" containerName="istio-proxy" Jul 12 20:02:05.374560 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.374298 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" containerName="istio-proxy" Jul 12 20:02:05.374560 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.374314 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea2839fd-26fa-47b7-b8b5-a1a37a533ab5" containerName="istio-proxy" Jul 12 20:02:05.379981 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.379959 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.382528 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.382509 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-txwrt\"/\"openshift-service-ca.crt\"" Jul 12 20:02:05.382637 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.382538 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-txwrt\"/\"default-dockercfg-44w77\"" Jul 12 20:02:05.383615 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.383598 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-txwrt\"/\"kube-root-ca.crt\"" Jul 12 20:02:05.387715 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.387683 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf"] Jul 12 20:02:05.541544 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.541509 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7dbe38cc-8698-4241-8991-56fc87df306e-proc\") pod \"perf-node-gather-daemonset-9wjwf\" (UID: \"7dbe38cc-8698-4241-8991-56fc87df306e\") " pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.541544 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.541549 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7dbe38cc-8698-4241-8991-56fc87df306e-podres\") pod \"perf-node-gather-daemonset-9wjwf\" (UID: \"7dbe38cc-8698-4241-8991-56fc87df306e\") " pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.541757 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.541664 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chj8l\" (UniqueName: \"kubernetes.io/projected/7dbe38cc-8698-4241-8991-56fc87df306e-kube-api-access-chj8l\") pod \"perf-node-gather-daemonset-9wjwf\" (UID: \"7dbe38cc-8698-4241-8991-56fc87df306e\") " pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.541757 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.541706 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7dbe38cc-8698-4241-8991-56fc87df306e-lib-modules\") pod \"perf-node-gather-daemonset-9wjwf\" (UID: \"7dbe38cc-8698-4241-8991-56fc87df306e\") " pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.541839 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.541805 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7dbe38cc-8698-4241-8991-56fc87df306e-sys\") pod \"perf-node-gather-daemonset-9wjwf\" (UID: \"7dbe38cc-8698-4241-8991-56fc87df306e\") " pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.642975 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.642889 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7dbe38cc-8698-4241-8991-56fc87df306e-sys\") pod \"perf-node-gather-daemonset-9wjwf\" (UID: \"7dbe38cc-8698-4241-8991-56fc87df306e\") " pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.642975 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.642929 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7dbe38cc-8698-4241-8991-56fc87df306e-proc\") pod \"perf-node-gather-daemonset-9wjwf\" (UID: \"7dbe38cc-8698-4241-8991-56fc87df306e\") " pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.642975 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.642955 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7dbe38cc-8698-4241-8991-56fc87df306e-podres\") pod \"perf-node-gather-daemonset-9wjwf\" (UID: \"7dbe38cc-8698-4241-8991-56fc87df306e\") " pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.643244 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.643007 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chj8l\" (UniqueName: \"kubernetes.io/projected/7dbe38cc-8698-4241-8991-56fc87df306e-kube-api-access-chj8l\") pod \"perf-node-gather-daemonset-9wjwf\" (UID: \"7dbe38cc-8698-4241-8991-56fc87df306e\") " pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.643244 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.643030 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7dbe38cc-8698-4241-8991-56fc87df306e-proc\") pod \"perf-node-gather-daemonset-9wjwf\" (UID: \"7dbe38cc-8698-4241-8991-56fc87df306e\") " pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.643244 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.643030 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7dbe38cc-8698-4241-8991-56fc87df306e-sys\") pod \"perf-node-gather-daemonset-9wjwf\" (UID: \"7dbe38cc-8698-4241-8991-56fc87df306e\") " pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.643244 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.643035 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7dbe38cc-8698-4241-8991-56fc87df306e-lib-modules\") pod \"perf-node-gather-daemonset-9wjwf\" (UID: \"7dbe38cc-8698-4241-8991-56fc87df306e\") " pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.643244 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.643133 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7dbe38cc-8698-4241-8991-56fc87df306e-podres\") pod \"perf-node-gather-daemonset-9wjwf\" (UID: \"7dbe38cc-8698-4241-8991-56fc87df306e\") " pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.643244 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.643200 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7dbe38cc-8698-4241-8991-56fc87df306e-lib-modules\") pod \"perf-node-gather-daemonset-9wjwf\" (UID: \"7dbe38cc-8698-4241-8991-56fc87df306e\") " pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.650600 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.650575 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chj8l\" (UniqueName: \"kubernetes.io/projected/7dbe38cc-8698-4241-8991-56fc87df306e-kube-api-access-chj8l\") pod \"perf-node-gather-daemonset-9wjwf\" (UID: \"7dbe38cc-8698-4241-8991-56fc87df306e\") " pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.692263 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.692232 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:05.825755 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:05.825731 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf"] Jul 12 20:02:05.827811 ip-10-0-133-234 kubenswrapper[2572]: W0712 20:02:05.827781 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7dbe38cc_8698_4241_8991_56fc87df306e.slice/crio-9cf26165fb1b1d54383c4f676d286ef851569d3c82dc0b5ea16ab796c7a17799 WatchSource:0}: Error finding container 9cf26165fb1b1d54383c4f676d286ef851569d3c82dc0b5ea16ab796c7a17799: Status 404 returned error can't find the container with id 9cf26165fb1b1d54383c4f676d286ef851569d3c82dc0b5ea16ab796c7a17799 Jul 12 20:02:06.610357 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:06.610323 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" event={"ID":"7dbe38cc-8698-4241-8991-56fc87df306e","Type":"ContainerStarted","Data":"998a607b92b5cc6c31dd465f38293ada36d52ca3bd92e4a74412622de4bffbaf"} Jul 12 20:02:06.610786 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:06.610378 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" event={"ID":"7dbe38cc-8698-4241-8991-56fc87df306e","Type":"ContainerStarted","Data":"9cf26165fb1b1d54383c4f676d286ef851569d3c82dc0b5ea16ab796c7a17799"} Jul 12 20:02:06.610786 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:06.610460 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:06.625485 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:06.625422 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" podStartSLOduration=1.625408875 podStartE2EDuration="1.625408875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 20:02:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 20:02:06.624343595 +0000 UTC m=+2526.158331770" watchObservedRunningTime="2026-07-12 20:02:06.625408875 +0000 UTC m=+2526.159397050" Jul 12 20:02:07.188120 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:07.188092 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kcrwk_37a6f7e0-6c8e-47db-b215-c38182a2a58d/dns/0.log" Jul 12 20:02:07.207073 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:07.207051 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kcrwk_37a6f7e0-6c8e-47db-b215-c38182a2a58d/kube-rbac-proxy/0.log" Jul 12 20:02:07.315632 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:07.315600 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xwlc6_f3efc208-7053-4f82-bcc6-6ee65940f9c5/dns-node-resolver/0.log" Jul 12 20:02:07.842436 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:07.842407 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5bd5759bb9-x2rlf_0439af22-5960-4616-b8f2-fb40f229e836/registry/0.log" Jul 12 20:02:07.862699 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:07.862678 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5pdfz_177e5598-3546-4a59-aca8-47ea7fd504a3/node-ca/0.log" Jul 12 20:02:08.922976 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:08.922946 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59ff7fb449-4g9pw_aa049892-e6e1-434d-ac2e-79e45bd343ac/kube-auth-proxy/0.log" Jul 12 20:02:09.073381 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:09.073355 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8jh7k_a2345147-f773-4400-a90c-e1e629330adb/payload-pre-processing/0.log" Jul 12 20:02:09.845002 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:09.844975 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zmnpn_f6c11714-ec96-445c-8eff-3b3c33906653/serve-healthcheck-canary/0.log" Jul 12 20:02:10.295597 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:10.295571 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-5gqk8_8524be03-4385-4b02-a94c-3828707d13d5/insights-operator/0.log" Jul 12 20:02:10.297075 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:10.297059 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-5gqk8_8524be03-4385-4b02-a94c-3828707d13d5/insights-operator/1.log" Jul 12 20:02:10.315663 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:10.315645 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-98rvr_72e53560-8031-4b38-bcfa-25ad4665c8cd/kube-rbac-proxy/0.log" Jul 12 20:02:10.335425 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:10.335405 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-98rvr_72e53560-8031-4b38-bcfa-25ad4665c8cd/exporter/0.log" Jul 12 20:02:10.355295 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:10.355264 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-98rvr_72e53560-8031-4b38-bcfa-25ad4665c8cd/extractor/0.log" Jul 12 20:02:12.626205 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:12.626178 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-txwrt/perf-node-gather-daemonset-9wjwf" Jul 12 20:02:12.787243 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:12.787206 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5699dc8655-799lh_ae83e1af-89de-4146-b98d-4fa4ea6001fb/manager/0.log" Jul 12 20:02:12.931768 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:12.931687 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68dff8c9d6-7hx4s_6553d1e0-17a1-4dfe-9ce1-4944940146d6/manager/0.log" Jul 12 20:02:12.954404 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:12.954378 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68dff8c9d6-7hx4s_6553d1e0-17a1-4dfe-9ce1-4944940146d6/copy-manifests/0.log" Jul 12 20:02:14.483649 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:14.483624 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-89775f59b-rxzs9_c3cda036-67de-4f79-bfd8-a0e3d1a6f0ff/manager/0.log" Jul 12 20:02:15.726338 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:15.726310 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59ff7fb449-4g9pw_aa049892-e6e1-434d-ac2e-79e45bd343ac/kube-auth-proxy/0.log" Jul 12 20:02:15.860328 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:15.860278 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8jh7k_a2345147-f773-4400-a90c-e1e629330adb/payload-pre-processing/0.log" Jul 12 20:02:17.314535 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:17.314449 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59ff7fb449-4g9pw_aa049892-e6e1-434d-ac2e-79e45bd343ac/kube-auth-proxy/0.log" Jul 12 20:02:17.440989 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:17.440959 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8jh7k_a2345147-f773-4400-a90c-e1e629330adb/payload-pre-processing/0.log" Jul 12 20:02:19.545265 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:19.545233 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-c49ft_5fdefaa7-1021-4bbd-8050-8c4e72e7854a/migrator/0.log" Jul 12 20:02:19.563163 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:19.563144 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-c49ft_5fdefaa7-1021-4bbd-8050-8c4e72e7854a/graceful-termination/0.log" Jul 12 20:02:19.900841 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:19.900799 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-zjwlz_db7d2e1a-d427-41f6-8273-a1d24a6910ab/kube-storage-version-migrator-operator/1.log" Jul 12 20:02:19.902174 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:19.902154 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-zjwlz_db7d2e1a-d427-41f6-8273-a1d24a6910ab/kube-storage-version-migrator-operator/0.log" Jul 12 20:02:20.814731 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:20.814706 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-74nhl_b8808a46-de8e-4f1d-b36a-eb8d99b160b3/kube-multus-additional-cni-plugins/0.log" Jul 12 20:02:20.835528 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:20.835504 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-74nhl_b8808a46-de8e-4f1d-b36a-eb8d99b160b3/egress-router-binary-copy/0.log" Jul 12 20:02:20.853839 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:20.853816 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-74nhl_b8808a46-de8e-4f1d-b36a-eb8d99b160b3/cni-plugins/0.log" Jul 12 20:02:20.873225 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:20.873204 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-74nhl_b8808a46-de8e-4f1d-b36a-eb8d99b160b3/bond-cni-plugin/0.log" Jul 12 20:02:20.893742 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:20.893720 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-74nhl_b8808a46-de8e-4f1d-b36a-eb8d99b160b3/routeoverride-cni/0.log" Jul 12 20:02:20.920259 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:20.920231 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-74nhl_b8808a46-de8e-4f1d-b36a-eb8d99b160b3/whereabouts-cni-bincopy/0.log" Jul 12 20:02:20.938809 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:20.938785 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-74nhl_b8808a46-de8e-4f1d-b36a-eb8d99b160b3/whereabouts-cni/0.log" Jul 12 20:02:21.291399 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:21.291370 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k9k2h_4495cbb3-2285-4359-a836-8130d15cc4b4/kube-multus/0.log" Jul 12 20:02:21.344826 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:21.344796 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5t7x2_9b658735-f326-4144-a145-c33b84cff253/network-metrics-daemon/0.log" Jul 12 20:02:21.363571 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:21.363547 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5t7x2_9b658735-f326-4144-a145-c33b84cff253/kube-rbac-proxy/0.log" Jul 12 20:02:22.252972 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:22.252946 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9s2cn_bb5a4a9e-03a6-417a-84f5-511c5278484f/ovn-controller/0.log" Jul 12 20:02:22.270892 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:22.270865 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9s2cn_bb5a4a9e-03a6-417a-84f5-511c5278484f/ovn-acl-logging/0.log" Jul 12 20:02:22.293080 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:22.293059 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9s2cn_bb5a4a9e-03a6-417a-84f5-511c5278484f/kube-rbac-proxy-node/0.log" Jul 12 20:02:22.312020 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:22.311998 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9s2cn_bb5a4a9e-03a6-417a-84f5-511c5278484f/kube-rbac-proxy-ovn-metrics/0.log" Jul 12 20:02:22.328806 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:22.328781 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9s2cn_bb5a4a9e-03a6-417a-84f5-511c5278484f/northd/0.log" Jul 12 20:02:22.350218 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:22.350195 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9s2cn_bb5a4a9e-03a6-417a-84f5-511c5278484f/nbdb/0.log" Jul 12 20:02:22.370161 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:22.370146 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9s2cn_bb5a4a9e-03a6-417a-84f5-511c5278484f/sbdb/0.log" Jul 12 20:02:22.419056 ip-10-0-133-234 kubenswrapper[2572]: I0712 20:02:22.419038 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9s2cn_bb5a4a9e-03a6-417a-84f5-511c5278484f/ovnkube-controller/0.log"