Jul 28 18:00:26.471188 ip-10-0-136-117 systemd[1]: Starting Kubernetes Kubelet... Jul 28 18:00:26.901445 ip-10-0-136-117 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 18:00:26.901445 ip-10-0-136-117 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 18:00:26.901445 ip-10-0-136-117 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 18:00:26.901445 ip-10-0-136-117 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 18:00:26.901445 ip-10-0-136-117 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 18:00:26.902169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.901506 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 18:00:26.909394 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909360 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 18:00:26.909394 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909387 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 18:00:26.909394 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909395 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 18:00:26.909394 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909398 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 18:00:26.909394 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909401 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 18:00:26.909394 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909404 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909408 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909411 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909413 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909416 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909419 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909423 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909426 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909428 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909431 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909436 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909439 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909442 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909445 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909448 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909451 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909457 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909460 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909462 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909465 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 18:00:26.909656 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909468 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909470 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909473 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909478 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909481 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909483 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909487 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909489 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909493 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909495 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909498 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909501 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909503 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909508 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909513 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909519 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909522 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909524 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909527 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909530 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 18:00:26.910148 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909532 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909535 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909537 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909540 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909543 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909546 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909548 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909554 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909557 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909561 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909563 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909566 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909568 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909571 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909573 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909576 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909578 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909581 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909583 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 18:00:26.910649 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909588 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909591 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909593 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909596 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909599 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909601 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909604 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909609 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909613 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909616 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909619 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909622 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909625 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909631 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909634 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909636 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909639 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909643 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909647 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 18:00:26.911169 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909649 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 18:00:26.911629 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909653 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 18:00:26.911629 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909656 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 18:00:26.911629 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909659 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 18:00:26.911629 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909663 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 18:00:26.911629 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909668 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 18:00:26.911629 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909672 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 18:00:26.911629 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909674 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 18:00:26.911629 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909677 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 18:00:26.911629 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909679 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 18:00:26.911629 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909682 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 18:00:26.911629 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909685 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 18:00:26.911629 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909687 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 18:00:26.911629 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909690 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 18:00:26.911629 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909692 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 18:00:26.911629 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.909695 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911894 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911903 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911907 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911911 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911917 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911920 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911923 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911925 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911928 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911931 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911934 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911937 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911939 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911942 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911945 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911947 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911950 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911955 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911957 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 18:00:26.911999 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911960 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911963 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911967 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911969 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911972 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911974 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911977 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911980 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911983 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911986 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911989 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911993 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911996 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.911999 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912003 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912006 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912009 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912012 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912014 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912017 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 18:00:26.912600 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912020 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912022 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912025 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912031 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912033 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912036 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912039 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912042 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912045 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912048 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912051 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912053 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912056 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912060 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912062 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912068 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912071 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912073 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912077 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 18:00:26.913238 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912080 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912083 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912085 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912088 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912090 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912094 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912097 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912100 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912105 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912108 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912110 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912113 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912116 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912120 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912123 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912126 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912129 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912131 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912134 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912136 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 18:00:26.913742 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912139 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912144 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912146 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912149 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912152 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912154 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912157 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912160 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912162 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912165 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912170 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912175 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912182 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912185 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912188 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912191 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912194 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912196 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912200 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 18:00:26.914248 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912204 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.912207 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913037 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913051 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913055 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913058 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913062 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913064 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913067 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913070 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913072 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913075 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913078 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913080 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913083 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913086 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913089 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913091 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913094 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913096 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 18:00:26.914715 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913098 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913101 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913103 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913106 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913109 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913111 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913113 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913116 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913118 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913121 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913124 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913126 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913130 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913133 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913135 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913139 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913142 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913144 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913147 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913149 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 18:00:26.915228 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913152 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913155 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913157 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913160 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913163 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913165 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913167 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913171 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913173 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913176 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913178 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913181 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913183 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913186 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913188 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913191 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913193 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913196 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913198 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 18:00:26.915709 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913201 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913203 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913205 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913209 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913212 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913215 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913219 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913223 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913229 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913232 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913235 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913238 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913241 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913245 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913248 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913251 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913253 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913256 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 18:00:26.916205 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913259 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913261 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913264 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913267 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913269 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913272 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913275 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913283 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913286 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913289 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913292 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913294 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913296 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913299 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913302 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913304 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913307 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913309 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913311 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913314 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 18:00:26.916680 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913316 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913319 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913323 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.913325 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913396 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913404 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913411 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913416 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913421 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913424 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913428 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913432 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913435 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913440 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913444 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913447 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913450 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913453 2563 flags.go:64] FLAG: --cgroup-root="" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913456 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913459 2563 flags.go:64] FLAG: --client-ca-file="" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913463 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913466 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913470 2563 flags.go:64] FLAG: --cluster-domain="" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913473 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 18:00:26.917211 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913476 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913479 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913483 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913486 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913489 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913492 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913495 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913498 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913501 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913505 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913509 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913512 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913517 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913520 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913523 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913525 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913528 2563 flags.go:64] FLAG: --enable-server="true" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913531 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913536 2563 flags.go:64] FLAG: --event-burst="100" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913540 2563 flags.go:64] FLAG: --event-qps="50" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913543 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913546 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913548 2563 flags.go:64] FLAG: --eviction-hard="" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913553 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 18:00:26.917810 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913556 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913559 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913562 2563 flags.go:64] FLAG: --eviction-soft="" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913565 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913567 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913571 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913574 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913576 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913579 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913582 2563 flags.go:64] FLAG: --feature-gates="" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913585 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913588 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913592 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913595 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913598 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913601 2563 flags.go:64] FLAG: --help="false" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913603 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-136-117.ec2.internal" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913606 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913611 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913614 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913617 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913620 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913623 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 18:00:26.918462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913626 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913628 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913631 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913634 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913637 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913640 2563 flags.go:64] FLAG: --kube-reserved="" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913643 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913645 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913648 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913651 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913655 2563 flags.go:64] FLAG: --lock-file="" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913658 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913661 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913664 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913669 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913673 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913676 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913679 2563 flags.go:64] FLAG: --logging-format="text" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913682 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913685 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913687 2563 flags.go:64] FLAG: --manifest-url="" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913690 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913695 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913698 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913702 2563 flags.go:64] FLAG: --max-pods="110" Jul 28 18:00:26.919069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913705 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913708 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913712 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913715 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913717 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913720 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913723 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913731 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913734 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913737 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913740 2563 flags.go:64] FLAG: --pod-cidr="" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913743 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913749 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913752 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913755 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913758 2563 flags.go:64] FLAG: --port="10250" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913761 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913765 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-089292625e3f72316" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913769 2563 flags.go:64] FLAG: --qos-reserved="" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913772 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913774 2563 flags.go:64] FLAG: --register-node="true" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913777 2563 flags.go:64] FLAG: --register-with-taints="" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913781 2563 flags.go:64] FLAG: --registry-burst="10" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913784 2563 flags.go:64] FLAG: --registry-qps="5" Jul 28 18:00:26.919685 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913787 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913790 2563 flags.go:64] FLAG: --reserved-memory="" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913797 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913800 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913802 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913805 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913808 2563 flags.go:64] FLAG: --runonce="false" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913811 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913814 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913817 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913819 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913824 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913827 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913830 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913833 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913835 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913839 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913841 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913844 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913862 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913865 2563 flags.go:64] FLAG: --system-cgroups="" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913868 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913873 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913876 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913879 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 18:00:26.920349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913884 2563 flags.go:64] FLAG: --tls-min-version="" Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913887 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913890 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913892 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913895 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913898 2563 flags.go:64] FLAG: --v="2" Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913902 2563 flags.go:64] FLAG: --version="false" Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913907 2563 flags.go:64] FLAG: --vmodule="" Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913911 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.913914 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914051 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914055 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914059 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914062 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914065 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914068 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914070 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914073 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914078 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914081 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914083 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914086 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 18:00:26.920989 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914089 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914092 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914094 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914097 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914100 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914102 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914105 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914108 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914110 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914114 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914119 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914122 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914125 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914128 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914130 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914133 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914135 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914138 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914141 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 18:00:26.921541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914143 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914146 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914149 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914151 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914154 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914156 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914159 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914163 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914166 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914170 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914173 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914176 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914179 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914182 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914184 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914187 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914189 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914192 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914195 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914197 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 18:00:26.922024 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914200 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914202 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914205 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914209 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914211 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914214 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914216 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914219 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914223 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914226 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914229 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914232 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914235 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914238 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914240 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914243 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914246 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914248 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914251 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914254 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 18:00:26.922518 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914257 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914261 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914264 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914266 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914269 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914271 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914274 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914276 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914279 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914281 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914284 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914287 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914289 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914292 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914295 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914298 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914301 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914304 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914306 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914309 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 18:00:26.923128 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914312 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 18:00:26.923615 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914314 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 18:00:26.923615 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914317 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 18:00:26.923615 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914319 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 18:00:26.923615 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914321 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 18:00:26.923615 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914324 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 18:00:26.923615 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914327 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 18:00:26.923615 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.914330 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 18:00:26.923615 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.914337 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 18:00:26.923615 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.921296 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 18:00:26.923615 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.921315 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 18:00:26.923615 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.921336 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 18:00:26.923615 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.921341 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 18:00:26.923615 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921401 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 18:00:26.923615 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921407 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921412 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921415 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921418 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921421 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921424 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921426 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921429 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921432 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921434 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921437 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921440 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921443 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921446 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921448 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921451 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921453 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921456 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921458 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921460 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 18:00:26.923990 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921463 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921465 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921468 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921471 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921474 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921477 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921479 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921482 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921485 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921488 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921491 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921493 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921496 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921498 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921501 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921503 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921506 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921508 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921511 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921513 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 18:00:26.924476 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921515 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921518 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921521 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921523 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921525 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921528 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921531 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921533 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921536 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921538 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921541 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921543 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921546 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921549 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921551 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921554 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921557 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921560 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921564 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 18:00:26.924986 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921567 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921571 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921574 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921577 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921581 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921585 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921588 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921590 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921593 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921596 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921599 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921601 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921604 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921606 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921608 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921611 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921614 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921616 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921618 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921621 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 18:00:26.925453 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921623 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921626 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921628 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921631 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921634 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921636 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921639 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921641 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921644 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921646 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921649 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921652 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921654 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921657 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921660 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921662 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921665 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921667 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 18:00:26.925983 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921670 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 18:00:26.926436 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.921675 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 18:00:26.926436 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921791 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 18:00:26.926436 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921795 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 18:00:26.926436 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921798 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 18:00:26.926436 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921801 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 18:00:26.926436 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921804 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 18:00:26.926436 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921807 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 18:00:26.926436 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921809 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 18:00:26.926436 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921812 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 18:00:26.926436 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921814 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 18:00:26.926436 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921817 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 18:00:26.926436 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921820 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 18:00:26.926436 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921822 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 18:00:26.926436 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921825 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 18:00:26.926436 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921827 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921830 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921832 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921835 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921838 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921840 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921843 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921845 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921869 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921872 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921875 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921878 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921881 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921884 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921887 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921889 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921892 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921894 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921897 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921900 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 18:00:26.926806 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921902 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921905 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921908 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921910 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921913 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921915 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921918 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921921 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921925 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921928 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921932 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921935 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921938 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921941 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921944 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921947 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921950 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921952 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921955 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 18:00:26.927334 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921957 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921960 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921963 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921965 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921969 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921972 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921975 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921977 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921980 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921982 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921985 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921987 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921989 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921992 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921994 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921997 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.921999 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922002 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922004 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922006 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 18:00:26.927801 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922009 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922011 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922014 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922016 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922019 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922021 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922025 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922029 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922032 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922036 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922039 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922042 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922044 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922047 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922049 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922052 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922054 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922058 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922060 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 18:00:26.928295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922063 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 18:00:26.928765 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922065 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 18:00:26.928765 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922067 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 18:00:26.928765 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922070 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 18:00:26.928765 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922073 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 18:00:26.928765 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922075 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 18:00:26.928765 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922077 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 18:00:26.928765 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:26.922080 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 18:00:26.928765 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.922085 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 18:00:26.928765 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.922219 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 18:00:26.928765 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.924190 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 18:00:26.928765 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.925785 2563 server.go:1019] "Starting client certificate rotation" Jul 28 18:00:26.928765 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.925883 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 18:00:26.928765 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.925923 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 18:00:26.929132 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.928336 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 18:00:26.929960 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.929945 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 18:00:26.941161 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.941136 2563 log.go:25] "Validated CRI v1 runtime API" Jul 28 18:00:26.945456 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.945436 2563 log.go:25] "Validated CRI v1 image API" Jul 28 18:00:26.947844 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.947820 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 18:00:26.951562 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.951541 2563 fs.go:135] Filesystem UUIDs: map[082d6570-ac14-420b-92e6-9310bb1bce16:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cdf29162-d722-4842-8442-aa03df1c3eda:/dev/nvme0n1p3] Jul 28 18:00:26.951648 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.951563 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 18:00:26.956924 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.956787 2563 manager.go:216] Machine: {Timestamp:2026-07-28 18:00:26.955499737 +0000 UTC m=+0.357044799 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106251 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b9c5ffc15a3cba7a83ec307ab5923 SystemUUID:ec2b9c5f-fc15-a3cb-a7a8-3ec307ab5923 BootID:2b2de072-281a-4664-ad14-b08b720028c4 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d3:5b:7f:c9:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d3:5b:7f:c9:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:76:3f:a0:4e:fc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 18:00:26.956924 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.956919 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 18:00:26.957027 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.957013 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 18:00:26.958677 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.958659 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 18:00:26.960493 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.960466 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 18:00:26.960641 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.960498 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 18:00:26.961138 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.961126 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 18:00:26.961178 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.961141 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 18:00:26.961178 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.961149 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 18:00:26.961178 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.961164 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 18:00:26.961989 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.961978 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 18:00:26.963529 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.963517 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 28 18:00:26.963644 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.963634 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 18:00:26.963681 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.963664 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 28 18:00:26.963681 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.963674 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 18:00:26.963752 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.963695 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 18:00:26.963752 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.963707 2563 kubelet.go:398] "Adding apiserver pod source" Jul 28 18:00:26.963752 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.963721 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 18:00:26.964117 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.964105 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 18:00:26.964164 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.964123 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 18:00:26.966571 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.966553 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 18:00:26.968261 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.968245 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 18:00:26.968341 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.968276 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 18:00:26.969798 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.969785 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 18:00:26.969837 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.969802 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 18:00:26.969837 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.969810 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 18:00:26.969837 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.969817 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 18:00:26.969837 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.969832 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 18:00:26.969974 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.969842 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 18:00:26.969974 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.969868 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 18:00:26.969974 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.969873 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 18:00:26.969974 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.969879 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 18:00:26.969974 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.969885 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 18:00:26.969974 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.969902 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 18:00:26.969974 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.969907 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 18:00:26.970626 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.970615 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 18:00:26.970626 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.970626 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 18:00:26.973868 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.973828 2563 server.go:1268] "Started kubelet" Jul 28 18:00:26.973994 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.973918 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 18:00:26.974384 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.974180 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 18:00:26.974529 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.974514 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 18:00:26.974836 ip-10-0-136-117 systemd[1]: Started Kubernetes Kubelet. Jul 28 18:00:26.976244 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.976222 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 18:00:26.976244 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:26.976228 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 18:00:26.976393 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.976283 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 28 18:00:26.976393 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:26.976327 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 18:00:26.976520 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.976492 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 18:00:26.981049 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:26.981024 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 18:00:26.983139 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:26.982181 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-117.ec2.internal.18c685fdb2e8b462 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-117.ec2.internal,UID:ip-10-0-136-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-117.ec2.internal,},FirstTimestamp:2026-07-28 18:00:26.973795426 +0000 UTC m=+0.375340488,LastTimestamp:2026-07-28 18:00:26.973795426 +0000 UTC m=+0.375340488,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-117.ec2.internal,}" Jul 28 18:00:26.983461 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.983445 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5dlz7" Jul 28 18:00:26.983945 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.983929 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 18:00:26.984012 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.983932 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 18:00:26.984076 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:26.984043 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found" Jul 28 18:00:26.984700 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.984682 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 18:00:26.984700 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.984701 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 18:00:26.984833 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.984684 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 18:00:26.984901 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.984841 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 28 18:00:26.984901 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.984875 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 28 18:00:26.985145 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.985101 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 18:00:26.985213 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.985147 2563 factory.go:55] Registering systemd factory Jul 28 18:00:26.985213 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.985157 2563 factory.go:223] Registration of the systemd container factory successfully Jul 28 18:00:26.985559 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.985541 2563 factory.go:153] Registering CRI-O factory Jul 28 18:00:26.985630 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.985561 2563 factory.go:223] Registration of the crio container factory successfully Jul 28 18:00:26.985630 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.985584 2563 factory.go:103] Registering Raw factory Jul 28 18:00:26.985630 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.985600 2563 manager.go:1196] Started watching for new ooms in manager Jul 28 18:00:26.986569 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.986552 2563 manager.go:349] Starting recovery of all containers Jul 28 18:00:26.987279 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:26.987253 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 18:00:26.987440 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:26.987418 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 18:00:26.992450 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.992423 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5dlz7" Jul 28 18:00:26.997507 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:26.997488 2563 manager.go:354] Recovery completed Jul 28 18:00:27.001878 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.001845 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 18:00:27.003739 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.003722 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientMemory" Jul 28 18:00:27.003831 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.003755 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 18:00:27.003831 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.003765 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientPID" Jul 28 18:00:27.004347 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.004334 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 18:00:27.004347 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.004346 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 18:00:27.004419 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.004361 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 28 18:00:27.004419 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.004339 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 18:00:27.005115 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.005099 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientMemory" Jul 28 18:00:27.005201 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.005127 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 18:00:27.005201 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.005147 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientPID" Jul 28 18:00:27.005718 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.005705 2563 policy_none.go:49] "None policy: Start" Jul 28 18:00:27.005774 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.005724 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 18:00:27.005774 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.005737 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 18:00:27.006207 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.006121 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-117.ec2.internal.18c685fdb4b1a4eb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-117.ec2.internal,UID:ip-10-0-136-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-117.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-117.ec2.internal,},FirstTimestamp:2026-07-28 18:00:27.003741419 +0000 UTC m=+0.405286480,LastTimestamp:2026-07-28 18:00:27.003741419 +0000 UTC m=+0.405286480,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-117.ec2.internal,}" Jul 28 18:00:27.006926 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.006913 2563 policy_none.go:47] "Start" Jul 28 18:00:27.052605 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.052387 2563 manager.go:337] "Starting Device Plugin manager" Jul 28 18:00:27.052735 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.052643 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 18:00:27.052735 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.052657 2563 server.go:87] "Starting device plugin registration server" Jul 28 18:00:27.052996 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.052981 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 18:00:27.053082 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.052998 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 18:00:27.053153 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.053115 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 18:00:27.053278 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.053244 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 18:00:27.053278 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.053255 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 18:00:27.053820 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.053794 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 18:00:27.053928 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.053862 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-117.ec2.internal\" not found" Jul 28 18:00:27.154170 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.154081 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 18:00:27.155201 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.155141 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientMemory" Jul 28 18:00:27.155201 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.155171 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 18:00:27.155201 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.155187 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientPID" Jul 28 18:00:27.155311 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.155223 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.164065 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.164044 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.164118 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.164071 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-117.ec2.internal\": node \"ip-10-0-136-117.ec2.internal\" not found" Jul 28 18:00:27.181894 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.181843 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found" Jul 28 18:00:27.227732 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.227688 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 18:00:27.229104 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.229081 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 18:00:27.229231 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.229122 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 18:00:27.229231 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.229150 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 18:00:27.229231 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.229191 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 18:00:27.232063 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.232045 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 18:00:27.282758 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.282723 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found" Jul 28 18:00:27.330204 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.330157 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal"] Jul 28 18:00:27.330356 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.330248 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 18:00:27.332007 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.331987 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientMemory" Jul 28 18:00:27.332125 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.332025 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 18:00:27.332125 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.332039 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientPID" Jul 28 18:00:27.333503 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.333486 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 18:00:27.333630 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.333612 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.333694 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.333651 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 18:00:27.334291 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.334269 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientMemory" Jul 28 18:00:27.334376 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.334304 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 18:00:27.334376 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.334314 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientPID" Jul 28 18:00:27.334376 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.334269 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientMemory" Jul 28 18:00:27.334478 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.334384 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 18:00:27.334478 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.334397 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientPID" Jul 28 18:00:27.335635 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.335621 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.335686 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.335648 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 18:00:27.336317 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.336302 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientMemory" Jul 28 18:00:27.336397 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.336324 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 18:00:27.336397 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.336335 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeHasSufficientPID" Jul 28 18:00:27.364724 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.364690 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-117.ec2.internal\" not found" node="ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.369254 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.369236 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-117.ec2.internal\" not found" node="ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.383582 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.383553 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found" Jul 28 18:00:27.387961 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.387939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e3c64a3cbc978c2ce69fb398febfaea2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-117.ec2.internal\" (UID: \"e3c64a3cbc978c2ce69fb398febfaea2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.388031 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.387969 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e257991d76476cb5525e016d37a0b5c7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal\" (UID: \"e257991d76476cb5525e016d37a0b5c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.388031 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.387987 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e257991d76476cb5525e016d37a0b5c7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal\" (UID: \"e257991d76476cb5525e016d37a0b5c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.484617 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.484548 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found" Jul 28 18:00:27.488839 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.488819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e257991d76476cb5525e016d37a0b5c7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal\" (UID: \"e257991d76476cb5525e016d37a0b5c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.488932 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.488845 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e257991d76476cb5525e016d37a0b5c7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal\" (UID: \"e257991d76476cb5525e016d37a0b5c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.488932 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.488891 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e3c64a3cbc978c2ce69fb398febfaea2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-117.ec2.internal\" (UID: \"e3c64a3cbc978c2ce69fb398febfaea2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.488999 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.488945 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e3c64a3cbc978c2ce69fb398febfaea2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-117.ec2.internal\" (UID: \"e3c64a3cbc978c2ce69fb398febfaea2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.488999 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.488944 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e257991d76476cb5525e016d37a0b5c7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal\" (UID: \"e257991d76476cb5525e016d37a0b5c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.488999 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.488945 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e257991d76476cb5525e016d37a0b5c7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal\" (UID: \"e257991d76476cb5525e016d37a0b5c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.585062 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.585008 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found" Jul 28 18:00:27.667371 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.667340 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.672184 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.672166 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal" Jul 28 18:00:27.685366 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.685340 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found" Jul 28 18:00:27.788145 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.788039 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found" Jul 28 18:00:27.812145 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.812120 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 18:00:27.889587 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.889545 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found" Jul 28 18:00:27.925828 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.925782 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 18:00:27.926338 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.925979 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 18:00:27.926338 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.926006 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 18:00:27.989819 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:27.989787 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-117.ec2.internal\" not found" Jul 28 18:00:27.997732 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.997694 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 17:55:27 +0000 UTC" deadline="2028-04-26 16:28:45.935690238 +0000 UTC" Jul 28 18:00:27.997732 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:27.997726 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15310h28m17.937968744s" Jul 28 18:00:28.016402 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.016366 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 18:00:28.085171 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.085072 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" Jul 28 18:00:28.102818 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.102786 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 18:00:28.104987 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.104967 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal" Jul 28 18:00:28.119110 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.119085 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 18:00:28.309012 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.308984 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 18:00:28.430835 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.430751 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 18:00:28.967046 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.967012 2563 apiserver.go:52] "Watching apiserver" Jul 28 18:00:28.979050 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.979012 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 18:00:28.981529 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.981499 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-rrw2c","kube-system/global-pull-secret-syncer-4jk9v","openshift-cluster-node-tuning-operator/tuned-8vbjf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal","openshift-multus/multus-t8vxl","openshift-network-diagnostics/network-check-target-bzrdk","openshift-ovn-kubernetes/ovnkube-node-s6qr4","kube-system/konnectivity-agent-6p8v5","kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v","openshift-dns/node-resolver-c665d","openshift-image-registry/node-ca-vkfbb","openshift-multus/multus-additional-cni-plugins-kd6vz","openshift-multus/network-metrics-daemon-8hvfx"] Jul 28 18:00:28.983174 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.983148 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:28.984453 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.984428 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:28.985032 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.984982 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 18:00:28.985693 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.985673 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:28.986273 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.986243 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 18:00:28.986273 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.986283 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zcqlh\"" Jul 28 18:00:28.986481 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.986424 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 18:00:28.986582 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.986566 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 18:00:28.987231 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.987212 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 18:00:28.987335 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.987282 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:28.987335 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.987212 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 18:00:28.987456 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:28.987364 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:28.987880 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.987682 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 18:00:28.987880 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.987735 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 18:00:28.987880 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.987760 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sz7k4\"" Jul 28 18:00:28.988173 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.988154 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 18:00:28.988282 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.988154 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 18:00:28.988870 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.988834 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 18:00:28.988956 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.988840 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9nr8f\"" Jul 28 18:00:28.988956 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.988951 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t8vxl" Jul 28 18:00:28.990432 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.990149 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:28.990432 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:28.990243 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:28.991441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.991419 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6p8v5" Jul 28 18:00:28.991683 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.991662 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 18:00:28.992219 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.991952 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-crjg7\"" Jul 28 18:00:28.992929 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.992908 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:28.994268 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.994250 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:28.994361 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:28.994343 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:28.995663 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.995644 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrw2c" Jul 28 18:00:28.996385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.996356 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 18:00:28.996466 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.996390 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 18:00:28.996466 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.996395 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 18:00:28.996888 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.996851 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-sysctl-d\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:28.996984 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.996887 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bd5a65a-bedf-4de1-a07a-610d3521385e-cnibin\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:28.996984 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.996952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9bd5a65a-bedf-4de1-a07a-610d3521385e-os-release\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:28.997082 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997007 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bd5a65a-bedf-4de1-a07a-610d3521385e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:28.997082 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997034 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-registration-dir\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:28.997082 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b82nd\" (UniqueName: \"kubernetes.io/projected/9bd5a65a-bedf-4de1-a07a-610d3521385e-kube-api-access-b82nd\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:28.997241 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997119 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-sysconfig\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:28.997241 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997169 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-sysctl-conf\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:28.997241 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997198 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-sys\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:28.997241 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzvws\" (UniqueName: \"kubernetes.io/projected/3a693470-0089-46e9-b784-3c45a95c2111-kube-api-access-lzvws\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:28.997403 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9bd5a65a-bedf-4de1-a07a-610d3521385e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:28.997403 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-run\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:28.997403 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997310 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-socket-dir\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:28.997403 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997334 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-device-dir\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:28.997403 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-sys-fs\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:28.997403 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bd5a65a-bedf-4de1-a07a-610d3521385e-system-cni-dir\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:28.997650 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9bd5a65a-bedf-4de1-a07a-610d3521385e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:28.997650 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-kubernetes\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:28.997650 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34a80947-7682-4671-aea7-ed8072e763e3-tmp\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:28.997650 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997501 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:28.997650 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997527 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-etc-selinux\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:28.997650 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997562 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-modprobe-d\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:28.997650 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997588 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-host\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:28.997650 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997615 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-systemd\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:28.997650 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-lib-modules\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:28.998176 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997686 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/34a80947-7682-4671-aea7-ed8072e763e3-etc-tuned\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:28.998176 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzscv\" (UniqueName: \"kubernetes.io/projected/34a80947-7682-4671-aea7-ed8072e763e3-kube-api-access-lzscv\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:28.998176 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997752 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bd5a65a-bedf-4de1-a07a-610d3521385e-cni-binary-copy\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:28.998176 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997796 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-var-lib-kubelet\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:28.998176 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.997850 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 18:00:28.998176 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.998108 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 18:00:28.998483 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.998252 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 18:00:28.998540 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.998514 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-84fhl\"" Jul 28 18:00:28.998784 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.998763 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 18:00:28.998851 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.998802 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 18:00:28.998956 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.998903 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 18:00:28.999019 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.998974 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c665d" Jul 28 18:00:28.999079 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.999025 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rpjn8\"" Jul 28 18:00:28.999481 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.999462 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 18:00:28.999785 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.999765 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 18:00:28.999878 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.999857 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vkfbb" Jul 28 18:00:29.000086 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:28.999972 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ggc8x\"" Jul 28 18:00:29.004329 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.003238 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 18:00:29.004329 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.003481 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 18:00:29.004329 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.003632 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 18:00:29.004329 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.003777 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x86pm\"" Jul 28 18:00:29.004329 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.003867 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 18:00:29.004329 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.003947 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 18:00:29.004329 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.004166 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-frg44\"" Jul 28 18:00:29.004900 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.004874 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 18:00:29.025320 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.025291 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4d7fk" Jul 28 18:00:29.033679 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.033650 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4d7fk" Jul 28 18:00:29.086566 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.086534 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 18:00:29.098254 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098207 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2303d131-0afd-44ba-9f4e-75ded817669c-kubelet-config\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:29.098254 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098251 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m779\" (UniqueName: \"kubernetes.io/projected/9c1cfedf-04f8-457f-bb58-e982eea0dd6f-kube-api-access-6m779\") pod \"iptables-alerter-rrw2c\" (UID: \"9c1cfedf-04f8-457f-bb58-e982eea0dd6f\") " pod="openshift-network-operator/iptables-alerter-rrw2c" Jul 28 18:00:29.098484 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098269 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-multus-cni-dir\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.098484 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-run-netns\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.098484 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098357 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-run\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.098484 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098402 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-socket-dir\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:29.098484 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098432 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34a80947-7682-4671-aea7-ed8072e763e3-tmp\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.098484 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098461 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/985f20a7-3708-4e65-813e-6c35a729145e-host\") pod \"node-ca-vkfbb\" (UID: \"985f20a7-3708-4e65-813e-6c35a729145e\") " pod="openshift-image-registry/node-ca-vkfbb" Jul 28 18:00:29.098484 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-run-openvswitch\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.098718 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098498 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-run\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.098718 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a3698e5-4a71-4928-a854-28b89fcebe5f-ovn-node-metrics-cert\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.098718 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098563 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:29.098718 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098588 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-run-k8s-cni-cncf-io\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.098718 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098599 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-socket-dir\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:29.098718 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098611 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twnch\" (UniqueName: \"kubernetes.io/projected/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-kube-api-access-twnch\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.098718 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098650 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a3698e5-4a71-4928-a854-28b89fcebe5f-env-overrides\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.098718 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098683 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzscv\" (UniqueName: \"kubernetes.io/projected/34a80947-7682-4671-aea7-ed8072e763e3-kube-api-access-lzscv\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.098718 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098711 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d515405-8064-4166-900b-d92ea2405bc3-agent-certs\") pod \"konnectivity-agent-6p8v5\" (UID: \"9d515405-8064-4166-900b-d92ea2405bc3\") " pod="kube-system/konnectivity-agent-6p8v5" Jul 28 18:00:29.098718 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098652 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:29.099110 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d515405-8064-4166-900b-d92ea2405bc3-konnectivity-ca\") pod \"konnectivity-agent-6p8v5\" (UID: \"9d515405-8064-4166-900b-d92ea2405bc3\") " pod="kube-system/konnectivity-agent-6p8v5" Jul 28 18:00:29.099110 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098800 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 18:00:29.099110 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098866 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-slash\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.099110 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098910 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-var-lib-kubelet\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.099110 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098931 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-etc-kubernetes\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.099110 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9bd5a65a-bedf-4de1-a07a-610d3521385e-os-release\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.099110 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098974 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-var-lib-kubelet\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.099110 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.098995 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bd5a65a-bedf-4de1-a07a-610d3521385e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.099110 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099020 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-multus-socket-dir-parent\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.099110 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099045 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.099110 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099071 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9bd5a65a-bedf-4de1-a07a-610d3521385e-os-release\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.099110 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099097 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-sysconfig\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-etc-openvswitch\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099154 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-sysconfig\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-sysctl-conf\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099165 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bd5a65a-bedf-4de1-a07a-610d3521385e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-sys\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099229 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-system-cni-dir\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099253 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-cni-binary-copy\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099275 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-var-lib-cni-multus\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099289 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-sysctl-conf\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099273 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-sys\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-systemd-units\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-run-multus-certs\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzvws\" (UniqueName: \"kubernetes.io/projected/3a693470-0089-46e9-b784-3c45a95c2111-kube-api-access-lzvws\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099357 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9bd5a65a-bedf-4de1-a07a-610d3521385e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0b28227-f549-4efc-8400-8b6e593bdbc7-hosts-file\") pod \"node-resolver-c665d\" (UID: \"f0b28227-f549-4efc-8400-8b6e593bdbc7\") " pod="openshift-dns/node-resolver-c665d" Jul 28 18:00:29.099531 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcq9f\" (UniqueName: \"kubernetes.io/projected/985f20a7-3708-4e65-813e-6c35a729145e-kube-api-access-vcq9f\") pod \"node-ca-vkfbb\" (UID: \"985f20a7-3708-4e65-813e-6c35a729145e\") " pod="openshift-image-registry/node-ca-vkfbb" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099422 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs\") pod \"network-metrics-daemon-8hvfx\" (UID: \"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75\") " pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-device-dir\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099462 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-sys-fs\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bd5a65a-bedf-4de1-a07a-610d3521385e-system-cni-dir\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9bd5a65a-bedf-4de1-a07a-610d3521385e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099516 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-kubernetes\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c1cfedf-04f8-457f-bb58-e982eea0dd6f-iptables-alerter-script\") pod \"iptables-alerter-rrw2c\" (UID: \"9c1cfedf-04f8-457f-bb58-e982eea0dd6f\") " pod="openshift-network-operator/iptables-alerter-rrw2c" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099567 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-run-systemd\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099581 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-run-ovn\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099600 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-etc-selinux\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099619 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-modprobe-d\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099634 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-host\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099681 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-run-netns\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099688 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-host\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099760 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-device-dir\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099795 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-systemd\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.100300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099809 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-sys-fs\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-lib-modules\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099868 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/34a80947-7682-4671-aea7-ed8072e763e3-etc-tuned\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099890 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-modprobe-d\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099897 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-kubernetes\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099920 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j74mr\" (UniqueName: \"kubernetes.io/projected/f0b28227-f549-4efc-8400-8b6e593bdbc7-kube-api-access-j74mr\") pod \"node-resolver-c665d\" (UID: \"f0b28227-f549-4efc-8400-8b6e593bdbc7\") " pod="openshift-dns/node-resolver-c665d" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.099950 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-os-release\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100006 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-etc-selinux\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100023 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-hostroot\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-kubelet\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100079 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-log-socket\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bd5a65a-bedf-4de1-a07a-610d3521385e-cni-binary-copy\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100135 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c1cfedf-04f8-457f-bb58-e982eea0dd6f-host-slash\") pod \"iptables-alerter-rrw2c\" (UID: \"9c1cfedf-04f8-457f-bb58-e982eea0dd6f\") " pod="openshift-network-operator/iptables-alerter-rrw2c" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100135 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9bd5a65a-bedf-4de1-a07a-610d3521385e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100162 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0b28227-f549-4efc-8400-8b6e593bdbc7-tmp-dir\") pod \"node-resolver-c665d\" (UID: \"f0b28227-f549-4efc-8400-8b6e593bdbc7\") " pod="openshift-dns/node-resolver-c665d" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100216 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v77v2\" (UniqueName: \"kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2\") pod \"network-check-target-bzrdk\" (UID: \"c3f3a583-1527-44a1-b22e-298a09afffdc\") " pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100235 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-systemd\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.101169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100243 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-cni-bin\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100282 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bd5a65a-bedf-4de1-a07a-610d3521385e-system-cni-dir\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100307 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-cni-netd\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100331 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9bd5a65a-bedf-4de1-a07a-610d3521385e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a3698e5-4a71-4928-a854-28b89fcebe5f-ovnkube-config\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100404 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-sysctl-d\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100454 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bd5a65a-bedf-4de1-a07a-610d3521385e-cnibin\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100474 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-lib-modules\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100483 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-var-lib-kubelet\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100541 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bd5a65a-bedf-4de1-a07a-610d3521385e-cnibin\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100583 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/34a80947-7682-4671-aea7-ed8072e763e3-etc-sysctl-d\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100638 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-multus-conf-dir\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100669 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-node-log\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a3698e5-4a71-4928-a854-28b89fcebe5f-ovnkube-script-lib\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100720 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bd5a65a-bedf-4de1-a07a-610d3521385e-cni-binary-copy\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7b9j\" (UniqueName: \"kubernetes.io/projected/9a3698e5-4a71-4928-a854-28b89fcebe5f-kube-api-access-g7b9j\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100769 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-registration-dir\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:29.101838 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100825 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b82nd\" (UniqueName: \"kubernetes.io/projected/9bd5a65a-bedf-4de1-a07a-610d3521385e-kube-api-access-b82nd\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.102648 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100875 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a693470-0089-46e9-b784-3c45a95c2111-registration-dir\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:29.102648 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100885 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-cnibin\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.102648 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.100911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-var-lib-cni-bin\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.102648 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.101006 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-multus-daemon-config\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.102648 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.101042 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/985f20a7-3708-4e65-813e-6c35a729145e-serviceca\") pod \"node-ca-vkfbb\" (UID: \"985f20a7-3708-4e65-813e-6c35a729145e\") " pod="openshift-image-registry/node-ca-vkfbb" Jul 28 18:00:29.102648 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.101066 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4ps7\" (UniqueName: \"kubernetes.io/projected/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-kube-api-access-w4ps7\") pod \"network-metrics-daemon-8hvfx\" (UID: \"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75\") " pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:29.102648 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.101083 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-var-lib-openvswitch\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.102648 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.101134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2303d131-0afd-44ba-9f4e-75ded817669c-dbus\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:29.102648 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.101172 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-run-ovn-kubernetes\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.103057 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.102947 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/34a80947-7682-4671-aea7-ed8072e763e3-etc-tuned\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.103057 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.103001 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34a80947-7682-4671-aea7-ed8072e763e3-tmp\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.109553 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.109529 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzvws\" (UniqueName: \"kubernetes.io/projected/3a693470-0089-46e9-b784-3c45a95c2111-kube-api-access-lzvws\") pod \"aws-ebs-csi-driver-node-qm86v\" (UID: \"3a693470-0089-46e9-b784-3c45a95c2111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:29.109698 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.109534 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzscv\" (UniqueName: \"kubernetes.io/projected/34a80947-7682-4671-aea7-ed8072e763e3-kube-api-access-lzscv\") pod \"tuned-8vbjf\" (UID: \"34a80947-7682-4671-aea7-ed8072e763e3\") " pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.113009 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.112985 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b82nd\" (UniqueName: \"kubernetes.io/projected/9bd5a65a-bedf-4de1-a07a-610d3521385e-kube-api-access-b82nd\") pod \"multus-additional-cni-plugins-kd6vz\" (UID: \"9bd5a65a-bedf-4de1-a07a-610d3521385e\") " pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.192732 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:29.192688 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode257991d76476cb5525e016d37a0b5c7.slice/crio-70c17d8f97720d333afa5a2dc403a19d60ab5be494b094ef54a15642277a3575 WatchSource:0}: Error finding container 70c17d8f97720d333afa5a2dc403a19d60ab5be494b094ef54a15642277a3575: Status 404 returned error can't find the container with id 70c17d8f97720d333afa5a2dc403a19d60ab5be494b094ef54a15642277a3575 Jul 28 18:00:29.201478 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201446 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-multus-socket-dir-parent\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.201611 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201496 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.201611 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201528 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-etc-openvswitch\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.201611 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201540 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-multus-socket-dir-parent\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.201611 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201558 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-system-cni-dir\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.201840 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201602 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-cni-binary-copy\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.201840 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201626 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-system-cni-dir\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.201840 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-var-lib-cni-multus\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.201840 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201667 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.201840 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201678 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-systemd-units\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.201840 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201693 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-etc-openvswitch\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.201840 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201721 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-run-multus-certs\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.201840 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201753 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:29.201840 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201777 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0b28227-f549-4efc-8400-8b6e593bdbc7-hosts-file\") pod \"node-resolver-c665d\" (UID: \"f0b28227-f549-4efc-8400-8b6e593bdbc7\") " pod="openshift-dns/node-resolver-c665d" Jul 28 18:00:29.201840 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201802 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcq9f\" (UniqueName: \"kubernetes.io/projected/985f20a7-3708-4e65-813e-6c35a729145e-kube-api-access-vcq9f\") pod \"node-ca-vkfbb\" (UID: \"985f20a7-3708-4e65-813e-6c35a729145e\") " pod="openshift-image-registry/node-ca-vkfbb" Jul 28 18:00:29.201840 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201829 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs\") pod \"network-metrics-daemon-8hvfx\" (UID: \"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75\") " pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201885 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c1cfedf-04f8-457f-bb58-e982eea0dd6f-iptables-alerter-script\") pod \"iptables-alerter-rrw2c\" (UID: \"9c1cfedf-04f8-457f-bb58-e982eea0dd6f\") " pod="openshift-network-operator/iptables-alerter-rrw2c" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201910 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-run-systemd\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.201962 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-run-ovn\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202011 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0b28227-f549-4efc-8400-8b6e593bdbc7-hosts-file\") pod \"node-resolver-c665d\" (UID: \"f0b28227-f549-4efc-8400-8b6e593bdbc7\") " pod="openshift-dns/node-resolver-c665d" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202030 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-systemd-units\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202038 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-run-ovn\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202077 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-run-multus-certs\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202101 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-var-lib-cni-multus\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-run-netns\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j74mr\" (UniqueName: \"kubernetes.io/projected/f0b28227-f549-4efc-8400-8b6e593bdbc7-kube-api-access-j74mr\") pod \"node-resolver-c665d\" (UID: \"f0b28227-f549-4efc-8400-8b6e593bdbc7\") " pod="openshift-dns/node-resolver-c665d" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202171 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-os-release\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.202179 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202186 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-hostroot\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202209 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-kubelet\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202226 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-log-socket\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202248 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-log-socket\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.202250 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret podName:2303d131-0afd-44ba-9f4e-75ded817669c nodeName:}" failed. No retries permitted until 2026-07-28 18:00:29.702227565 +0000 UTC m=+3.103772645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret") pod "global-pull-secret-syncer-4jk9v" (UID: "2303d131-0afd-44ba-9f4e-75ded817669c") : object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:29.202441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202272 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-run-netns\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202283 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-cni-binary-copy\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202305 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c1cfedf-04f8-457f-bb58-e982eea0dd6f-host-slash\") pod \"iptables-alerter-rrw2c\" (UID: \"9c1cfedf-04f8-457f-bb58-e982eea0dd6f\") " pod="openshift-network-operator/iptables-alerter-rrw2c" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202337 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0b28227-f549-4efc-8400-8b6e593bdbc7-tmp-dir\") pod \"node-resolver-c665d\" (UID: \"f0b28227-f549-4efc-8400-8b6e593bdbc7\") " pod="openshift-dns/node-resolver-c665d" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202354 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v77v2\" (UniqueName: \"kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2\") pod \"network-check-target-bzrdk\" (UID: \"c3f3a583-1527-44a1-b22e-298a09afffdc\") " pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.202363 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-cni-bin\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202390 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-cni-netd\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202411 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-cni-netd\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.202419 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs podName:6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:29.702391744 +0000 UTC m=+3.103936794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs") pod "network-metrics-daemon-8hvfx" (UID: "6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202449 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-hostroot\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202450 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-run-systemd\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202479 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c1cfedf-04f8-457f-bb58-e982eea0dd6f-host-slash\") pod \"iptables-alerter-rrw2c\" (UID: \"9c1cfedf-04f8-457f-bb58-e982eea0dd6f\") " pod="openshift-network-operator/iptables-alerter-rrw2c" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202501 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-kubelet\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202578 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-os-release\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202612 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a3698e5-4a71-4928-a854-28b89fcebe5f-ovnkube-config\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-var-lib-kubelet\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202676 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-multus-conf-dir\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.203459 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202707 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-node-log\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202734 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a3698e5-4a71-4928-a854-28b89fcebe5f-ovnkube-script-lib\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202759 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-cni-bin\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202765 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7b9j\" (UniqueName: \"kubernetes.io/projected/9a3698e5-4a71-4928-a854-28b89fcebe5f-kube-api-access-g7b9j\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202797 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-multus-conf-dir\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202797 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-cnibin\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202825 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c1cfedf-04f8-457f-bb58-e982eea0dd6f-iptables-alerter-script\") pod \"iptables-alerter-rrw2c\" (UID: \"9c1cfedf-04f8-457f-bb58-e982eea0dd6f\") " pod="openshift-network-operator/iptables-alerter-rrw2c" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202834 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-var-lib-cni-bin\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202840 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-var-lib-kubelet\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202737 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0b28227-f549-4efc-8400-8b6e593bdbc7-tmp-dir\") pod \"node-resolver-c665d\" (UID: \"f0b28227-f549-4efc-8400-8b6e593bdbc7\") " pod="openshift-dns/node-resolver-c665d" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202873 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-multus-daemon-config\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202955 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-cnibin\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202965 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-node-log\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202984 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-var-lib-cni-bin\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.202992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/985f20a7-3708-4e65-813e-6c35a729145e-serviceca\") pod \"node-ca-vkfbb\" (UID: \"985f20a7-3708-4e65-813e-6c35a729145e\") " pod="openshift-image-registry/node-ca-vkfbb" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4ps7\" (UniqueName: \"kubernetes.io/projected/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-kube-api-access-w4ps7\") pod \"network-metrics-daemon-8hvfx\" (UID: \"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75\") " pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203074 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-var-lib-openvswitch\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203104 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2303d131-0afd-44ba-9f4e-75ded817669c-dbus\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:29.204385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-run-ovn-kubernetes\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203231 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2303d131-0afd-44ba-9f4e-75ded817669c-kubelet-config\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203241 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-var-lib-openvswitch\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203256 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m779\" (UniqueName: \"kubernetes.io/projected/9c1cfedf-04f8-457f-bb58-e982eea0dd6f-kube-api-access-6m779\") pod \"iptables-alerter-rrw2c\" (UID: \"9c1cfedf-04f8-457f-bb58-e982eea0dd6f\") " pod="openshift-network-operator/iptables-alerter-rrw2c" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-multus-cni-dir\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203307 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-run-netns\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203337 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/985f20a7-3708-4e65-813e-6c35a729145e-host\") pod \"node-ca-vkfbb\" (UID: \"985f20a7-3708-4e65-813e-6c35a729145e\") " pod="openshift-image-registry/node-ca-vkfbb" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-run-openvswitch\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203390 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a3698e5-4a71-4928-a854-28b89fcebe5f-ovn-node-metrics-cert\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203404 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/985f20a7-3708-4e65-813e-6c35a729145e-serviceca\") pod \"node-ca-vkfbb\" (UID: \"985f20a7-3708-4e65-813e-6c35a729145e\") " pod="openshift-image-registry/node-ca-vkfbb" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203420 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-multus-daemon-config\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203418 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-run-k8s-cni-cncf-io\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203472 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2303d131-0afd-44ba-9f4e-75ded817669c-kubelet-config\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twnch\" (UniqueName: \"kubernetes.io/projected/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-kube-api-access-twnch\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203517 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-run-openvswitch\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203561 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-run-netns\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203566 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a3698e5-4a71-4928-a854-28b89fcebe5f-env-overrides\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203573 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-multus-cni-dir\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.205281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203602 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d515405-8064-4166-900b-d92ea2405bc3-agent-certs\") pod \"konnectivity-agent-6p8v5\" (UID: \"9d515405-8064-4166-900b-d92ea2405bc3\") " pod="kube-system/konnectivity-agent-6p8v5" Jul 28 18:00:29.205862 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203606 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/985f20a7-3708-4e65-813e-6c35a729145e-host\") pod \"node-ca-vkfbb\" (UID: \"985f20a7-3708-4e65-813e-6c35a729145e\") " pod="openshift-image-registry/node-ca-vkfbb" Jul 28 18:00:29.205862 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203610 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a3698e5-4a71-4928-a854-28b89fcebe5f-ovnkube-config\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.205862 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203615 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a3698e5-4a71-4928-a854-28b89fcebe5f-ovnkube-script-lib\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.205862 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203631 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2303d131-0afd-44ba-9f4e-75ded817669c-dbus\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:29.205862 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203630 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d515405-8064-4166-900b-d92ea2405bc3-konnectivity-ca\") pod \"konnectivity-agent-6p8v5\" (UID: \"9d515405-8064-4166-900b-d92ea2405bc3\") " pod="kube-system/konnectivity-agent-6p8v5" Jul 28 18:00:29.205862 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203683 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-slash\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.205862 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203702 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-host-run-k8s-cni-cncf-io\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.205862 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203711 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-etc-kubernetes\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.205862 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203841 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-etc-kubernetes\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.205862 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.203953 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-slash\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.205862 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.204007 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a3698e5-4a71-4928-a854-28b89fcebe5f-host-run-ovn-kubernetes\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.205862 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.204351 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d515405-8064-4166-900b-d92ea2405bc3-konnectivity-ca\") pod \"konnectivity-agent-6p8v5\" (UID: \"9d515405-8064-4166-900b-d92ea2405bc3\") " pod="kube-system/konnectivity-agent-6p8v5" Jul 28 18:00:29.205862 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.205008 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a3698e5-4a71-4928-a854-28b89fcebe5f-env-overrides\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.210040 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.207295 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a3698e5-4a71-4928-a854-28b89fcebe5f-ovn-node-metrics-cert\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.211444 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.211417 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d515405-8064-4166-900b-d92ea2405bc3-agent-certs\") pod \"konnectivity-agent-6p8v5\" (UID: \"9d515405-8064-4166-900b-d92ea2405bc3\") " pod="kube-system/konnectivity-agent-6p8v5" Jul 28 18:00:29.212621 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.212573 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 18:00:29.212712 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.212627 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 18:00:29.212712 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.212644 2563 projected.go:196] Error preparing data for projected volume kube-api-access-v77v2 for pod openshift-network-diagnostics/network-check-target-bzrdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:29.212919 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.212902 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2 podName:c3f3a583-1527-44a1-b22e-298a09afffdc nodeName:}" failed. No retries permitted until 2026-07-28 18:00:29.71285627 +0000 UTC m=+3.114401341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v77v2" (UniqueName: "kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2") pod "network-check-target-bzrdk" (UID: "c3f3a583-1527-44a1-b22e-298a09afffdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:29.215470 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.215443 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcq9f\" (UniqueName: \"kubernetes.io/projected/985f20a7-3708-4e65-813e-6c35a729145e-kube-api-access-vcq9f\") pod \"node-ca-vkfbb\" (UID: \"985f20a7-3708-4e65-813e-6c35a729145e\") " pod="openshift-image-registry/node-ca-vkfbb" Jul 28 18:00:29.215750 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.215727 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j74mr\" (UniqueName: \"kubernetes.io/projected/f0b28227-f549-4efc-8400-8b6e593bdbc7-kube-api-access-j74mr\") pod \"node-resolver-c665d\" (UID: \"f0b28227-f549-4efc-8400-8b6e593bdbc7\") " pod="openshift-dns/node-resolver-c665d" Jul 28 18:00:29.217499 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.217444 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twnch\" (UniqueName: \"kubernetes.io/projected/afc30e7e-46f4-4447-a054-5c4a81f1ce0a-kube-api-access-twnch\") pod \"multus-t8vxl\" (UID: \"afc30e7e-46f4-4447-a054-5c4a81f1ce0a\") " pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.217727 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.217707 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4ps7\" (UniqueName: \"kubernetes.io/projected/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-kube-api-access-w4ps7\") pod \"network-metrics-daemon-8hvfx\" (UID: \"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75\") " pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:29.218101 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.218072 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7b9j\" (UniqueName: \"kubernetes.io/projected/9a3698e5-4a71-4928-a854-28b89fcebe5f-kube-api-access-g7b9j\") pod \"ovnkube-node-s6qr4\" (UID: \"9a3698e5-4a71-4928-a854-28b89fcebe5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.218181 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.218150 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m779\" (UniqueName: \"kubernetes.io/projected/9c1cfedf-04f8-457f-bb58-e982eea0dd6f-kube-api-access-6m779\") pod \"iptables-alerter-rrw2c\" (UID: \"9c1cfedf-04f8-457f-bb58-e982eea0dd6f\") " pod="openshift-network-operator/iptables-alerter-rrw2c" Jul 28 18:00:29.233903 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.233823 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" event={"ID":"e257991d76476cb5525e016d37a0b5c7","Type":"ContainerStarted","Data":"70c17d8f97720d333afa5a2dc403a19d60ab5be494b094ef54a15642277a3575"} Jul 28 18:00:29.235063 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.235032 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal" event={"ID":"e3c64a3cbc978c2ce69fb398febfaea2","Type":"ContainerStarted","Data":"2aba736ca5f2e47f615d40fe7dc0247c2550cb3b1b3a5525ab8f204eea34b008"} Jul 28 18:00:29.295508 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.295459 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" Jul 28 18:00:29.304777 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.304745 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kd6vz" Jul 28 18:00:29.314198 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.314171 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" Jul 28 18:00:29.321202 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.321176 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t8vxl" Jul 28 18:00:29.328172 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.328144 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6p8v5" Jul 28 18:00:29.336146 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.336120 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:29.347260 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.347226 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrw2c" Jul 28 18:00:29.353320 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.353288 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c665d" Jul 28 18:00:29.359123 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.359093 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vkfbb" Jul 28 18:00:29.430108 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.430065 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 18:00:29.708781 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.708742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:29.708781 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.708782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs\") pod \"network-metrics-daemon-8hvfx\" (UID: \"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75\") " pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:29.709062 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.708907 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:29.709062 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.708911 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:29.709062 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.708981 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs podName:6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:30.708960115 +0000 UTC m=+4.110505168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs") pod "network-metrics-daemon-8hvfx" (UID: "6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:29.709062 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.708997 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret podName:2303d131-0afd-44ba-9f4e-75ded817669c nodeName:}" failed. No retries permitted until 2026-07-28 18:00:30.708990605 +0000 UTC m=+4.110535656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret") pod "global-pull-secret-syncer-4jk9v" (UID: "2303d131-0afd-44ba-9f4e-75ded817669c") : object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:29.809899 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:29.809799 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v77v2\" (UniqueName: \"kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2\") pod \"network-check-target-bzrdk\" (UID: \"c3f3a583-1527-44a1-b22e-298a09afffdc\") " pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:29.810048 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.809955 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 18:00:29.810048 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.809973 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 18:00:29.810048 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.809983 2563 projected.go:196] Error preparing data for projected volume kube-api-access-v77v2 for pod openshift-network-diagnostics/network-check-target-bzrdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:29.810048 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:29.810044 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2 podName:c3f3a583-1527-44a1-b22e-298a09afffdc nodeName:}" failed. No retries permitted until 2026-07-28 18:00:30.810030178 +0000 UTC m=+4.211575228 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v77v2" (UniqueName: "kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2") pod "network-check-target-bzrdk" (UID: "c3f3a583-1527-44a1-b22e-298a09afffdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:29.935376 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:29.935340 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a80947_7682_4671_aea7_ed8072e763e3.slice/crio-9ca675c61f0fbfa9562f6ecaabbfb0ea61aa16117ca3aebacdcc0ec6ab066084 WatchSource:0}: Error finding container 9ca675c61f0fbfa9562f6ecaabbfb0ea61aa16117ca3aebacdcc0ec6ab066084: Status 404 returned error can't find the container with id 9ca675c61f0fbfa9562f6ecaabbfb0ea61aa16117ca3aebacdcc0ec6ab066084 Jul 28 18:00:29.952567 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:29.952543 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1cfedf_04f8_457f_bb58_e982eea0dd6f.slice/crio-ce752d7723dcbad7d1293f067676663130d5b9a30fc57f3e07a10a77d0ff703e WatchSource:0}: Error finding container ce752d7723dcbad7d1293f067676663130d5b9a30fc57f3e07a10a77d0ff703e: Status 404 returned error can't find the container with id ce752d7723dcbad7d1293f067676663130d5b9a30fc57f3e07a10a77d0ff703e Jul 28 18:00:29.956623 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:29.956592 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d515405_8064_4166_900b_d92ea2405bc3.slice/crio-417aec42152fbadfae87985e3a0b077e9c193100ff42a7e37b10c601a89530d0 WatchSource:0}: Error finding container 417aec42152fbadfae87985e3a0b077e9c193100ff42a7e37b10c601a89530d0: Status 404 returned error can't find the container with id 417aec42152fbadfae87985e3a0b077e9c193100ff42a7e37b10c601a89530d0 Jul 28 18:00:29.957666 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:29.957638 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a693470_0089_46e9_b784_3c45a95c2111.slice/crio-824ff77fa6054f472bcd0eca0dc1399e4e01c7e00ebe03aaeaa551142cc421ef WatchSource:0}: Error finding container 824ff77fa6054f472bcd0eca0dc1399e4e01c7e00ebe03aaeaa551142cc421ef: Status 404 returned error can't find the container with id 824ff77fa6054f472bcd0eca0dc1399e4e01c7e00ebe03aaeaa551142cc421ef Jul 28 18:00:29.958171 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:29.958110 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod985f20a7_3708_4e65_813e_6c35a729145e.slice/crio-8b7718258036f493a6e69476b25a92184b4b50af525eb0b961b25c01f25db8f5 WatchSource:0}: Error finding container 8b7718258036f493a6e69476b25a92184b4b50af525eb0b961b25c01f25db8f5: Status 404 returned error can't find the container with id 8b7718258036f493a6e69476b25a92184b4b50af525eb0b961b25c01f25db8f5 Jul 28 18:00:29.960505 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:29.960479 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3698e5_4a71_4928_a854_28b89fcebe5f.slice/crio-763c1db4b1765ea029419b3ef01e874b57709888f8fa34a534d3040121a698de WatchSource:0}: Error finding container 763c1db4b1765ea029419b3ef01e874b57709888f8fa34a534d3040121a698de: Status 404 returned error can't find the container with id 763c1db4b1765ea029419b3ef01e874b57709888f8fa34a534d3040121a698de Jul 28 18:00:29.962394 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:29.962102 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b28227_f549_4efc_8400_8b6e593bdbc7.slice/crio-1765436f41113cfb2512b5f76fed03244ffab250a0630a1e552bcd970835b20e WatchSource:0}: Error finding container 1765436f41113cfb2512b5f76fed03244ffab250a0630a1e552bcd970835b20e: Status 404 returned error can't find the container with id 1765436f41113cfb2512b5f76fed03244ffab250a0630a1e552bcd970835b20e Jul 28 18:00:29.963815 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:29.963780 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafc30e7e_46f4_4447_a054_5c4a81f1ce0a.slice/crio-17ea39da957652652a56c410f76c9a50aaef499a68c968301dae0d0274a4efdf WatchSource:0}: Error finding container 17ea39da957652652a56c410f76c9a50aaef499a68c968301dae0d0274a4efdf: Status 404 returned error can't find the container with id 17ea39da957652652a56c410f76c9a50aaef499a68c968301dae0d0274a4efdf Jul 28 18:00:29.965171 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:00:29.965153 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd5a65a_bedf_4de1_a07a_610d3521385e.slice/crio-d37622c4915a3b0c55355b45edea5d44ed4097ee7d660ff2e78e2bcb94601cc5 WatchSource:0}: Error finding container d37622c4915a3b0c55355b45edea5d44ed4097ee7d660ff2e78e2bcb94601cc5: Status 404 returned error can't find the container with id d37622c4915a3b0c55355b45edea5d44ed4097ee7d660ff2e78e2bcb94601cc5 Jul 28 18:00:30.035732 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.035666 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:55:29 +0000 UTC" deadline="2028-02-09 20:09:16.263209255 +0000 UTC" Jul 28 18:00:30.035732 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.035723 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13466h8m46.227490132s" Jul 28 18:00:30.238233 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.238137 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrw2c" event={"ID":"9c1cfedf-04f8-457f-bb58-e982eea0dd6f","Type":"ContainerStarted","Data":"ce752d7723dcbad7d1293f067676663130d5b9a30fc57f3e07a10a77d0ff703e"} Jul 28 18:00:30.239557 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.239525 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd6vz" event={"ID":"9bd5a65a-bedf-4de1-a07a-610d3521385e","Type":"ContainerStarted","Data":"d37622c4915a3b0c55355b45edea5d44ed4097ee7d660ff2e78e2bcb94601cc5"} Jul 28 18:00:30.241237 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.241211 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c665d" event={"ID":"f0b28227-f549-4efc-8400-8b6e593bdbc7","Type":"ContainerStarted","Data":"1765436f41113cfb2512b5f76fed03244ffab250a0630a1e552bcd970835b20e"} Jul 28 18:00:30.242579 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.242552 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" event={"ID":"9a3698e5-4a71-4928-a854-28b89fcebe5f","Type":"ContainerStarted","Data":"763c1db4b1765ea029419b3ef01e874b57709888f8fa34a534d3040121a698de"} Jul 28 18:00:30.243935 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.243899 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" event={"ID":"3a693470-0089-46e9-b784-3c45a95c2111","Type":"ContainerStarted","Data":"824ff77fa6054f472bcd0eca0dc1399e4e01c7e00ebe03aaeaa551142cc421ef"} Jul 28 18:00:30.245077 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.245049 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6p8v5" event={"ID":"9d515405-8064-4166-900b-d92ea2405bc3","Type":"ContainerStarted","Data":"417aec42152fbadfae87985e3a0b077e9c193100ff42a7e37b10c601a89530d0"} Jul 28 18:00:30.246164 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.246138 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" event={"ID":"34a80947-7682-4671-aea7-ed8072e763e3","Type":"ContainerStarted","Data":"9ca675c61f0fbfa9562f6ecaabbfb0ea61aa16117ca3aebacdcc0ec6ab066084"} Jul 28 18:00:30.248739 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.248715 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal" event={"ID":"e3c64a3cbc978c2ce69fb398febfaea2","Type":"ContainerStarted","Data":"81cd3e104363f6980ccf98bd7dc9f7612e3fb23c78fa4c7c360d35fe94a563d3"} Jul 28 18:00:30.250135 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.250104 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t8vxl" event={"ID":"afc30e7e-46f4-4447-a054-5c4a81f1ce0a","Type":"ContainerStarted","Data":"17ea39da957652652a56c410f76c9a50aaef499a68c968301dae0d0274a4efdf"} Jul 28 18:00:30.251495 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.251470 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vkfbb" event={"ID":"985f20a7-3708-4e65-813e-6c35a729145e","Type":"ContainerStarted","Data":"8b7718258036f493a6e69476b25a92184b4b50af525eb0b961b25c01f25db8f5"} Jul 28 18:00:30.265529 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.265485 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 18:00:30.273307 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.273238 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-117.ec2.internal" podStartSLOduration=2.273216633 podStartE2EDuration="2.273216633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:30.273161437 +0000 UTC m=+3.674706512" watchObservedRunningTime="2026-07-28 18:00:30.273216633 +0000 UTC m=+3.674761706" Jul 28 18:00:30.717109 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.716785 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:30.717109 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.717088 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs\") pod \"network-metrics-daemon-8hvfx\" (UID: \"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75\") " pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:30.717109 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:30.717101 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:30.717417 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:30.717204 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret podName:2303d131-0afd-44ba-9f4e-75ded817669c nodeName:}" failed. No retries permitted until 2026-07-28 18:00:32.717176197 +0000 UTC m=+6.118721261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret") pod "global-pull-secret-syncer-4jk9v" (UID: "2303d131-0afd-44ba-9f4e-75ded817669c") : object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:30.717417 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:30.717301 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:30.717417 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:30.717361 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs podName:6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:32.717344436 +0000 UTC m=+6.118889489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs") pod "network-metrics-daemon-8hvfx" (UID: "6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:30.818545 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:30.818505 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v77v2\" (UniqueName: \"kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2\") pod \"network-check-target-bzrdk\" (UID: \"c3f3a583-1527-44a1-b22e-298a09afffdc\") " pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:30.818737 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:30.818692 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 18:00:30.818737 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:30.818721 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 18:00:30.818737 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:30.818734 2563 projected.go:196] Error preparing data for projected volume kube-api-access-v77v2 for pod openshift-network-diagnostics/network-check-target-bzrdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:30.818918 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:30.818790 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2 podName:c3f3a583-1527-44a1-b22e-298a09afffdc nodeName:}" failed. No retries permitted until 2026-07-28 18:00:32.818772011 +0000 UTC m=+6.220317077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v77v2" (UniqueName: "kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2") pod "network-check-target-bzrdk" (UID: "c3f3a583-1527-44a1-b22e-298a09afffdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:31.036150 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:31.035909 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:55:29 +0000 UTC" deadline="2028-05-09 17:57:24.871019992 +0000 UTC" Jul 28 18:00:31.036150 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:31.035950 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15623h56m53.835074601s" Jul 28 18:00:31.232592 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:31.232555 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:31.232771 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:31.232712 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:31.233215 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:31.233190 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:31.233321 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:31.233305 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:31.233381 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:31.233368 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:31.233461 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:31.233440 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:32.732997 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:32.732957 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:32.733483 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:32.733015 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs\") pod \"network-metrics-daemon-8hvfx\" (UID: \"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75\") " pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:32.733483 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:32.733170 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:32.733483 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:32.733182 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:32.733483 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:32.733246 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret podName:2303d131-0afd-44ba-9f4e-75ded817669c nodeName:}" failed. No retries permitted until 2026-07-28 18:00:36.733225899 +0000 UTC m=+10.134770971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret") pod "global-pull-secret-syncer-4jk9v" (UID: "2303d131-0afd-44ba-9f4e-75ded817669c") : object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:32.733483 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:32.733268 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs podName:6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:36.733257634 +0000 UTC m=+10.134802688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs") pod "network-metrics-daemon-8hvfx" (UID: "6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:32.833498 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:32.833455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v77v2\" (UniqueName: \"kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2\") pod \"network-check-target-bzrdk\" (UID: \"c3f3a583-1527-44a1-b22e-298a09afffdc\") " pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:32.833676 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:32.833630 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 18:00:32.833676 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:32.833649 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 18:00:32.833676 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:32.833661 2563 projected.go:196] Error preparing data for projected volume kube-api-access-v77v2 for pod openshift-network-diagnostics/network-check-target-bzrdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:32.833889 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:32.833722 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2 podName:c3f3a583-1527-44a1-b22e-298a09afffdc nodeName:}" failed. No retries permitted until 2026-07-28 18:00:36.833702205 +0000 UTC m=+10.235247274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v77v2" (UniqueName: "kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2") pod "network-check-target-bzrdk" (UID: "c3f3a583-1527-44a1-b22e-298a09afffdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:33.232429 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:33.231992 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:33.232429 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:33.232016 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:33.232429 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:33.232083 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:33.232429 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:33.232199 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:33.232429 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:33.232283 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:33.232429 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:33.232374 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:35.232047 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:35.231965 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:35.232494 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:35.232110 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:35.232579 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:35.232514 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:35.232639 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:35.232618 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:35.232698 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:35.232665 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:35.232752 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:35.232741 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:36.767669 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:36.767629 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:36.767669 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:36.767675 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs\") pod \"network-metrics-daemon-8hvfx\" (UID: \"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75\") " pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:36.768356 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:36.767796 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:36.768356 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:36.767804 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:36.768356 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:36.767880 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs podName:6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:44.767840383 +0000 UTC m=+18.169385437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs") pod "network-metrics-daemon-8hvfx" (UID: "6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:36.768356 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:36.767954 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret podName:2303d131-0afd-44ba-9f4e-75ded817669c nodeName:}" failed. No retries permitted until 2026-07-28 18:00:44.767935437 +0000 UTC m=+18.169480493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret") pod "global-pull-secret-syncer-4jk9v" (UID: "2303d131-0afd-44ba-9f4e-75ded817669c") : object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:36.869295 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:36.868564 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v77v2\" (UniqueName: \"kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2\") pod \"network-check-target-bzrdk\" (UID: \"c3f3a583-1527-44a1-b22e-298a09afffdc\") " pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:36.869295 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:36.868827 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 18:00:36.869295 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:36.868846 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 18:00:36.869295 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:36.868870 2563 projected.go:196] Error preparing data for projected volume kube-api-access-v77v2 for pod openshift-network-diagnostics/network-check-target-bzrdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:36.869295 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:36.868923 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2 podName:c3f3a583-1527-44a1-b22e-298a09afffdc nodeName:}" failed. No retries permitted until 2026-07-28 18:00:44.868910338 +0000 UTC m=+18.270455387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v77v2" (UniqueName: "kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2") pod "network-check-target-bzrdk" (UID: "c3f3a583-1527-44a1-b22e-298a09afffdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:37.230993 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:37.230907 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:37.231122 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:37.231027 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:37.231397 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:37.231381 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:37.231479 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:37.231459 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:37.231640 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:37.231613 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:37.231743 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:37.231726 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:39.230235 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:39.230193 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:39.230718 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:39.230341 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:39.230718 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:39.230357 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:39.230718 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:39.230464 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:39.230718 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:39.230514 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:39.230718 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:39.230587 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:41.229735 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:41.229699 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:41.230213 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:41.229699 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:41.230213 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:41.229867 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:41.230213 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:41.229866 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:41.230213 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:41.229988 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:41.230213 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:41.230115 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:43.229829 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:43.229793 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:43.230352 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:43.229793 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:43.230352 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:43.229793 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:43.230352 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:43.229949 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:43.230352 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:43.230032 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:43.230352 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:43.230093 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:44.831671 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:44.831570 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:44.831671 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:44.831621 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs\") pod \"network-metrics-daemon-8hvfx\" (UID: \"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75\") " pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:44.832290 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:44.831720 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:44.832290 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:44.831790 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs podName:6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:00.831774335 +0000 UTC m=+34.233319385 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs") pod "network-metrics-daemon-8hvfx" (UID: "6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:44.832290 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:44.831720 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:44.832290 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:44.832152 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret podName:2303d131-0afd-44ba-9f4e-75ded817669c nodeName:}" failed. No retries permitted until 2026-07-28 18:01:00.832138913 +0000 UTC m=+34.233683962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret") pod "global-pull-secret-syncer-4jk9v" (UID: "2303d131-0afd-44ba-9f4e-75ded817669c") : object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:44.932986 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:44.932941 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v77v2\" (UniqueName: \"kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2\") pod \"network-check-target-bzrdk\" (UID: \"c3f3a583-1527-44a1-b22e-298a09afffdc\") " pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:44.933181 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:44.933115 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 18:00:44.933181 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:44.933137 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 18:00:44.933181 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:44.933151 2563 projected.go:196] Error preparing data for projected volume kube-api-access-v77v2 for pod openshift-network-diagnostics/network-check-target-bzrdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:44.933347 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:44.933226 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2 podName:c3f3a583-1527-44a1-b22e-298a09afffdc nodeName:}" failed. No retries permitted until 2026-07-28 18:01:00.933206437 +0000 UTC m=+34.334751501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v77v2" (UniqueName: "kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2") pod "network-check-target-bzrdk" (UID: "c3f3a583-1527-44a1-b22e-298a09afffdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:45.230262 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:45.230171 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:45.230262 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:45.230171 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:45.230485 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:45.230311 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:45.230485 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:45.230171 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:45.230485 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:45.230388 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:45.230485 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:45.230428 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:47.230145 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:47.230112 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:47.230634 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:47.230218 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:47.230634 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:47.230263 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:47.230634 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:47.230415 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:47.230634 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:47.230423 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:47.230634 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:47.230513 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:49.230057 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:49.230028 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:49.230504 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:49.230166 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:49.230606 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:49.230581 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:49.230717 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:49.230682 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:49.231437 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:49.231416 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:49.231542 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:49.231521 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:49.303791 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:49.303757 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" event={"ID":"9a3698e5-4a71-4928-a854-28b89fcebe5f","Type":"ContainerStarted","Data":"a1023f02364933889d7921ea03d1300894a58c728eb8e8f456419ef17ac38ee0"} Jul 28 18:00:49.303982 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:49.303833 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" event={"ID":"9a3698e5-4a71-4928-a854-28b89fcebe5f","Type":"ContainerStarted","Data":"88679045cce4de54d8e07d1fa4b475bcf70c3fc4463f87c7da70481e214d9910"} Jul 28 18:00:49.305360 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:49.305324 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" event={"ID":"34a80947-7682-4671-aea7-ed8072e763e3","Type":"ContainerStarted","Data":"48cde0c195f0c4df6c98c2d327e2591d406ddb4416b09ada5706dcf5ca7c0636"} Jul 28 18:00:49.306695 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:49.306668 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t8vxl" event={"ID":"afc30e7e-46f4-4447-a054-5c4a81f1ce0a","Type":"ContainerStarted","Data":"085f8c2bea68fed3c41ad3e0c193a4887f45e100492b4da5de37258819d5223d"} Jul 28 18:00:49.307833 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:49.307808 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vkfbb" event={"ID":"985f20a7-3708-4e65-813e-6c35a729145e","Type":"ContainerStarted","Data":"f5bf055e3028cfd748c7bfde7929109937f1954ca8fc47e4aa1784f7e8a9e6a9"} Jul 28 18:00:49.373655 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:49.373610 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vkfbb" podStartSLOduration=3.462401566 podStartE2EDuration="22.373594668s" totalImagesPullingTime="18.911193102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:49.37320609 +0000 UTC m=+22.774751172" watchObservedRunningTime="2026-07-28 18:00:49.373594668 +0000 UTC m=+22.775139739" Jul 28 18:00:49.373964 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:49.373940 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t8vxl" podStartSLOduration=3.465165146 podStartE2EDuration="22.373932783s" totalImagesPullingTime="18.908767637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:49.352584823 +0000 UTC m=+22.754129895" watchObservedRunningTime="2026-07-28 18:00:49.373932783 +0000 UTC m=+22.775477854" Jul 28 18:00:49.396824 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:49.396748 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8vbjf" podStartSLOduration=3.460989331 podStartE2EDuration="22.396732897s" totalImagesPullingTime="18.935743566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:49.396064191 +0000 UTC m=+22.797609261" watchObservedRunningTime="2026-07-28 18:00:49.396732897 +0000 UTC m=+22.798277968" Jul 28 18:00:50.312323 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.312111 2563 generic.go:356] "Generic (PLEG): container finished" podID="9bd5a65a-bedf-4de1-a07a-610d3521385e" containerID="8a5cbafe201fb716400649085d97728bd321021754e3a3d2230e87bf1c07c6eb" exitCode=0 Jul 28 18:00:50.313005 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.312150 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd6vz" event={"ID":"9bd5a65a-bedf-4de1-a07a-610d3521385e","Type":"ContainerDied","Data":"8a5cbafe201fb716400649085d97728bd321021754e3a3d2230e87bf1c07c6eb"} Jul 28 18:00:50.314176 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.314147 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c665d" event={"ID":"f0b28227-f549-4efc-8400-8b6e593bdbc7","Type":"ContainerStarted","Data":"d7fd4d2bfac44c20d5f660f7afe2f926ba3cea97fa4b04ae42fe71cb447ae02e"} Jul 28 18:00:50.317566 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.317543 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" event={"ID":"9a3698e5-4a71-4928-a854-28b89fcebe5f","Type":"ContainerStarted","Data":"638fb1b2085754ceea20dc0180600d1c470f6875894a983c91a378ad7984faf5"} Jul 28 18:00:50.317669 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.317622 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" event={"ID":"9a3698e5-4a71-4928-a854-28b89fcebe5f","Type":"ContainerStarted","Data":"3b2cc9e4ed6857ef2cff7a2d092cbd15a69a4c418065b33b2ba1904e6af79437"} Jul 28 18:00:50.317732 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.317678 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" event={"ID":"9a3698e5-4a71-4928-a854-28b89fcebe5f","Type":"ContainerStarted","Data":"74edbcd11cf7435b2618a881058c85462c98b3ab9d2b359d683dde7fa785bd75"} Jul 28 18:00:50.317732 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.317725 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" event={"ID":"9a3698e5-4a71-4928-a854-28b89fcebe5f","Type":"ContainerStarted","Data":"beb0ae844eb5c6e1cd3ac8c3ee5774bd1ec6296dd463597012993aea31ccbcbd"} Jul 28 18:00:50.319198 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.319168 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" event={"ID":"3a693470-0089-46e9-b784-3c45a95c2111","Type":"ContainerStarted","Data":"cb57af249fe56ea4ce74b6b519e4df8def32eca42a28adf1d383e6260f1e2210"} Jul 28 18:00:50.320699 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.320676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6p8v5" event={"ID":"9d515405-8064-4166-900b-d92ea2405bc3","Type":"ContainerStarted","Data":"b522010221ca0347879e9591820fcba5b11f6faba8b656959af87c5248f10502"} Jul 28 18:00:50.322182 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.322151 2563 generic.go:356] "Generic (PLEG): container finished" podID="e257991d76476cb5525e016d37a0b5c7" containerID="12b9f87408a3702858a01f3e2b8e01f701e06ecd6904f29aebba3df167a63903" exitCode=0 Jul 28 18:00:50.322283 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.322189 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" event={"ID":"e257991d76476cb5525e016d37a0b5c7","Type":"ContainerDied","Data":"12b9f87408a3702858a01f3e2b8e01f701e06ecd6904f29aebba3df167a63903"} Jul 28 18:00:50.323778 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.323755 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrw2c" event={"ID":"9c1cfedf-04f8-457f-bb58-e982eea0dd6f","Type":"ContainerStarted","Data":"9cb1171ecef3ff8bd9e8bab3c2c8f3a11d2fee4ebc55c00bc1af26d9e06875d9"} Jul 28 18:00:50.358563 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.358486 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6p8v5" podStartSLOduration=8.937297115 podStartE2EDuration="23.358465608s" totalImagesPullingTime="14.421168493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:50.358239391 +0000 UTC m=+23.759784464" watchObservedRunningTime="2026-07-28 18:00:50.358465608 +0000 UTC m=+23.760010694" Jul 28 18:00:50.377030 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.376979 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rrw2c" podStartSLOduration=4.459132191 podStartE2EDuration="23.376962948s" totalImagesPullingTime="18.917830757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:50.37671322 +0000 UTC m=+23.778258292" watchObservedRunningTime="2026-07-28 18:00:50.376962948 +0000 UTC m=+23.778508029" Jul 28 18:00:50.396887 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.396815 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c665d" podStartSLOduration=4.566969065 podStartE2EDuration="23.396797813s" totalImagesPullingTime="18.829828748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:50.396212277 +0000 UTC m=+23.797757347" watchObservedRunningTime="2026-07-28 18:00:50.396797813 +0000 UTC m=+23.798342878" Jul 28 18:00:50.583571 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.583447 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:50.660240 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.660207 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:50.782582 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:50.782554 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 18:00:51.066450 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:51.066347 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T18:00:50.782574709Z","UUID":"e8ae0f0f-e1e5-42d6-a402-203bb16d32ca","Handler":null,"Name":"","Endpoint":""} Jul 28 18:00:51.067896 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:51.067870 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 18:00:51.068037 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:51.067919 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 18:00:51.229663 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:51.229632 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:51.229966 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:51.229632 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:51.229966 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:51.229783 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:51.229966 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:51.229776 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:51.229966 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:51.229920 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:51.230144 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:51.229997 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:51.328690 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:51.328605 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" event={"ID":"3a693470-0089-46e9-b784-3c45a95c2111","Type":"ContainerStarted","Data":"c66dd334c4fec6b843da6dbff9dfe43aaa79b5bf2787de34bf526d16c959fe91"} Jul 28 18:00:51.330739 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:51.330705 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" event={"ID":"e257991d76476cb5525e016d37a0b5c7","Type":"ContainerStarted","Data":"1b7300e02a75d8e83a5d949f6d2b977da41cca64b0c6463f2ee88f97a0cfc8ba"} Jul 28 18:00:52.337042 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:52.337003 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" event={"ID":"9a3698e5-4a71-4928-a854-28b89fcebe5f","Type":"ContainerStarted","Data":"7fd590d766db9bf8512c18e249e068628d4b42bf86e4a2ed0da4883c15b4e58c"} Jul 28 18:00:53.229618 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:53.229540 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:53.229778 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:53.229677 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:53.230396 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:53.230377 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:53.230488 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:53.230469 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:53.230561 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:53.230546 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:53.230656 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:53.230637 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:53.342026 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:53.341986 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" event={"ID":"3a693470-0089-46e9-b784-3c45a95c2111","Type":"ContainerStarted","Data":"971f48469adc0a4bb91a406e8036b1e65680bf908a92fe58749f6b05e3c26cf5"} Jul 28 18:00:53.364576 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:53.364524 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm86v" podStartSLOduration=4.131980079 podStartE2EDuration="26.364507469s" totalImagesPullingTime="22.23252739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:53.36421456 +0000 UTC m=+26.765759631" watchObservedRunningTime="2026-07-28 18:00:53.364507469 +0000 UTC m=+26.766052540" Jul 28 18:00:53.365063 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:53.365031 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-117.ec2.internal" podStartSLOduration=25.365020443 podStartE2EDuration="25.365020443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:51.357085419 +0000 UTC m=+24.758630491" watchObservedRunningTime="2026-07-28 18:00:53.365020443 +0000 UTC m=+26.766565514" Jul 28 18:00:54.366949 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:54.366911 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6p8v5" Jul 28 18:00:54.367507 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:54.367483 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6p8v5" Jul 28 18:00:55.229779 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:55.229604 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:55.229966 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:55.229609 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:55.229966 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:55.229875 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:55.230109 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:55.229969 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:55.230109 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:55.229638 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:55.230109 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:55.230064 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:55.348471 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:55.348441 2563 generic.go:356] "Generic (PLEG): container finished" podID="9bd5a65a-bedf-4de1-a07a-610d3521385e" containerID="e3771580d9bc49fa7906aa3198865e6f73877230d93e3a86c0615a1e5bd24960" exitCode=0 Jul 28 18:00:55.348683 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:55.348522 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd6vz" event={"ID":"9bd5a65a-bedf-4de1-a07a-610d3521385e","Type":"ContainerDied","Data":"e3771580d9bc49fa7906aa3198865e6f73877230d93e3a86c0615a1e5bd24960"} Jul 28 18:00:55.352392 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:55.352358 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" event={"ID":"9a3698e5-4a71-4928-a854-28b89fcebe5f","Type":"ContainerStarted","Data":"eb3b9be2a3f948d27dff87fa1572e26d4d4390bc5eb2921bed58ce5e97911340"} Jul 28 18:00:55.352764 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:55.352733 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6p8v5" Jul 28 18:00:55.352907 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:55.352891 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:55.352969 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:55.352952 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:55.353021 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:55.352984 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:55.353372 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:55.353356 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6p8v5" Jul 28 18:00:55.369560 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:55.369533 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:55.370160 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:55.369638 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:00:55.454594 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:55.454545 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" podStartSLOduration=9.35270544 podStartE2EDuration="28.454528163s" totalImagesPullingTime="19.101822723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:55.45281234 +0000 UTC m=+28.854357411" watchObservedRunningTime="2026-07-28 18:00:55.454528163 +0000 UTC m=+28.856073226" Jul 28 18:00:55.493037 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:55.492952 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:56.683936 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:56.683658 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bzrdk"] Jul 28 18:00:56.684346 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:56.683977 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:56.684346 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:56.684088 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:56.686544 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:56.686513 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4jk9v"] Jul 28 18:00:56.686717 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:56.686648 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:56.686782 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:56.686741 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:56.687167 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:56.687146 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8hvfx"] Jul 28 18:00:56.687264 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:56.687236 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:56.687331 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:56.687311 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:57.359920 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:57.359887 2563 generic.go:356] "Generic (PLEG): container finished" podID="9bd5a65a-bedf-4de1-a07a-610d3521385e" containerID="4d82cd619a3632ec180d1cfd63bec25a6456f3746a4781b21ad5a38f24f5c744" exitCode=0 Jul 28 18:00:57.360119 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:57.359967 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd6vz" event={"ID":"9bd5a65a-bedf-4de1-a07a-610d3521385e","Type":"ContainerDied","Data":"4d82cd619a3632ec180d1cfd63bec25a6456f3746a4781b21ad5a38f24f5c744"} Jul 28 18:00:58.230122 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:58.230092 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:00:58.230496 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:58.230087 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:00:58.230496 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:58.230220 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:00:58.230496 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:58.230255 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:00:58.230496 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:58.230328 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:00:58.230496 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:00:58.230399 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:00:59.367658 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:59.367627 2563 generic.go:356] "Generic (PLEG): container finished" podID="9bd5a65a-bedf-4de1-a07a-610d3521385e" containerID="4ba0f5e3c96bdebeec4487ba9e3329570922db5ba6e22c9b279b0a83cf37ec6c" exitCode=0 Jul 28 18:00:59.368049 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:00:59.367690 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd6vz" event={"ID":"9bd5a65a-bedf-4de1-a07a-610d3521385e","Type":"ContainerDied","Data":"4ba0f5e3c96bdebeec4487ba9e3329570922db5ba6e22c9b279b0a83cf37ec6c"} Jul 28 18:01:00.229948 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:00.229835 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:01:00.230132 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:00.229866 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:01:00.230132 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:00.229979 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzrdk" podUID="c3f3a583-1527-44a1-b22e-298a09afffdc" Jul 28 18:01:00.230132 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:00.229993 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:01:00.230132 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:00.230091 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hvfx" podUID="6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75" Jul 28 18:01:00.230314 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:00.230245 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jk9v" podUID="2303d131-0afd-44ba-9f4e-75ded817669c" Jul 28 18:01:00.849937 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:00.849904 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:01:00.850381 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:00.849944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs\") pod \"network-metrics-daemon-8hvfx\" (UID: \"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75\") " pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:01:00.850381 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:00.850068 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 18:01:00.850381 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:00.850092 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:01:00.850381 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:00.850122 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret podName:2303d131-0afd-44ba-9f4e-75ded817669c nodeName:}" failed. No retries permitted until 2026-07-28 18:01:32.850107416 +0000 UTC m=+66.251652466 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret") pod "global-pull-secret-syncer-4jk9v" (UID: "2303d131-0afd-44ba-9f4e-75ded817669c") : object "kube-system"/"original-pull-secret" not registered Jul 28 18:01:00.850381 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:00.850145 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs podName:6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:32.850129416 +0000 UTC m=+66.251674466 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs") pod "network-metrics-daemon-8hvfx" (UID: "6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:01:00.950388 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:00.950344 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v77v2\" (UniqueName: \"kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2\") pod \"network-check-target-bzrdk\" (UID: \"c3f3a583-1527-44a1-b22e-298a09afffdc\") " pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:01:00.950584 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:00.950489 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 18:01:00.950584 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:00.950508 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 18:01:00.950584 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:00.950521 2563 projected.go:196] Error preparing data for projected volume kube-api-access-v77v2 for pod openshift-network-diagnostics/network-check-target-bzrdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:01:00.950584 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:00.950580 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2 podName:c3f3a583-1527-44a1-b22e-298a09afffdc nodeName:}" failed. No retries permitted until 2026-07-28 18:01:32.950560902 +0000 UTC m=+66.352105954 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v77v2" (UniqueName: "kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2") pod "network-check-target-bzrdk" (UID: "c3f3a583-1527-44a1-b22e-298a09afffdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:01:01.865539 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:01.865501 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-117.ec2.internal" event="NodeReady" Jul 28 18:01:01.865936 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:01.865664 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 18:01:01.943986 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:01.943942 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nshmr"] Jul 28 18:01:01.946222 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:01.946197 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nshmr" Jul 28 18:01:01.949062 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:01.949035 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6gmr5\"" Jul 28 18:01:01.949169 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:01.949111 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 18:01:01.949798 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:01.949778 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 18:01:01.950583 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:01.950108 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 18:01:01.950987 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:01.950968 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lwrff"] Jul 28 18:01:01.952817 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:01.952796 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:01.956442 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:01.955845 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 18:01:01.956442 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:01.956141 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 18:01:01.956442 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:01.956359 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-68ztc\"" Jul 28 18:01:01.962487 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:01.962431 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nshmr"] Jul 28 18:01:01.970262 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:01.970232 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lwrff"] Jul 28 18:01:02.059163 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.059129 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-tmp-dir\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:02.059163 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.059167 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-config-volume\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:02.059382 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.059207 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1443152a-ab29-4506-b24d-820dbe81be9c-cert\") pod \"ingress-canary-nshmr\" (UID: \"1443152a-ab29-4506-b24d-820dbe81be9c\") " pod="openshift-ingress-canary/ingress-canary-nshmr" Jul 28 18:01:02.059382 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.059234 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg5v5\" (UniqueName: \"kubernetes.io/projected/1443152a-ab29-4506-b24d-820dbe81be9c-kube-api-access-mg5v5\") pod \"ingress-canary-nshmr\" (UID: \"1443152a-ab29-4506-b24d-820dbe81be9c\") " pod="openshift-ingress-canary/ingress-canary-nshmr" Jul 28 18:01:02.059382 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.059262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:02.059382 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.059282 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk5lm\" (UniqueName: \"kubernetes.io/projected/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-kube-api-access-bk5lm\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:02.160192 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.160101 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1443152a-ab29-4506-b24d-820dbe81be9c-cert\") pod \"ingress-canary-nshmr\" (UID: \"1443152a-ab29-4506-b24d-820dbe81be9c\") " pod="openshift-ingress-canary/ingress-canary-nshmr" Jul 28 18:01:02.160192 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.160144 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg5v5\" (UniqueName: \"kubernetes.io/projected/1443152a-ab29-4506-b24d-820dbe81be9c-kube-api-access-mg5v5\") pod \"ingress-canary-nshmr\" (UID: \"1443152a-ab29-4506-b24d-820dbe81be9c\") " pod="openshift-ingress-canary/ingress-canary-nshmr" Jul 28 18:01:02.160192 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.160170 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:02.160463 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.160193 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk5lm\" (UniqueName: \"kubernetes.io/projected/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-kube-api-access-bk5lm\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:02.160463 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:02.160291 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:01:02.160463 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:02.160362 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls podName:8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c nodeName:}" failed. No retries permitted until 2026-07-28 18:01:02.660341676 +0000 UTC m=+36.061886741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls") pod "dns-default-lwrff" (UID: "8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c") : secret "dns-default-metrics-tls" not found Jul 28 18:01:02.160635 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.160471 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-tmp-dir\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:02.160635 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.160498 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-config-volume\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:02.160929 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.160881 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-tmp-dir\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:02.161172 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.161148 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-config-volume\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:02.165548 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.165515 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1443152a-ab29-4506-b24d-820dbe81be9c-cert\") pod \"ingress-canary-nshmr\" (UID: \"1443152a-ab29-4506-b24d-820dbe81be9c\") " pod="openshift-ingress-canary/ingress-canary-nshmr" Jul 28 18:01:02.170244 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.170221 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk5lm\" (UniqueName: \"kubernetes.io/projected/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-kube-api-access-bk5lm\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:02.170699 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.170677 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg5v5\" (UniqueName: \"kubernetes.io/projected/1443152a-ab29-4506-b24d-820dbe81be9c-kube-api-access-mg5v5\") pod \"ingress-canary-nshmr\" (UID: \"1443152a-ab29-4506-b24d-820dbe81be9c\") " pod="openshift-ingress-canary/ingress-canary-nshmr" Jul 28 18:01:02.229611 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.229578 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:01:02.229611 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.229589 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:01:02.229896 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.229582 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:01:02.233042 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.233018 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 18:01:02.233188 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.233066 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8nzx7\"" Jul 28 18:01:02.233188 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.233066 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 18:01:02.233418 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.233397 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 18:01:02.233532 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.233459 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 18:01:02.233532 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.233399 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d6nqr\"" Jul 28 18:01:02.257769 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.257744 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nshmr" Jul 28 18:01:02.664682 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:02.664643 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:02.664955 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:02.664819 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:01:02.664955 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:02.664907 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls podName:8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c nodeName:}" failed. No retries permitted until 2026-07-28 18:01:03.664891545 +0000 UTC m=+37.066436594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls") pod "dns-default-lwrff" (UID: "8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c") : secret "dns-default-metrics-tls" not found Jul 28 18:01:03.003349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:03.003263 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:03.339563 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:03.339534 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nshmr"] Jul 28 18:01:03.342655 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:01:03.342622 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1443152a_ab29_4506_b24d_820dbe81be9c.slice/crio-16eeaf339db0fecbb9b66cbc9b829392b899166aad4f8f4398fd7f8c39fa0685 WatchSource:0}: Error finding container 16eeaf339db0fecbb9b66cbc9b829392b899166aad4f8f4398fd7f8c39fa0685: Status 404 returned error can't find the container with id 16eeaf339db0fecbb9b66cbc9b829392b899166aad4f8f4398fd7f8c39fa0685 Jul 28 18:01:03.378642 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:03.378431 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nshmr" event={"ID":"1443152a-ab29-4506-b24d-820dbe81be9c","Type":"ContainerStarted","Data":"16eeaf339db0fecbb9b66cbc9b829392b899166aad4f8f4398fd7f8c39fa0685"} Jul 28 18:01:03.381349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:03.381321 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd6vz" event={"ID":"9bd5a65a-bedf-4de1-a07a-610d3521385e","Type":"ContainerStarted","Data":"626d5c6942609cf874451ccd1178f1f2107d4fff734ba0898f0881fb20938dc7"} Jul 28 18:01:03.673831 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:03.673724 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:03.673992 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:03.673897 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:01:03.673992 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:03.673963 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls podName:8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c nodeName:}" failed. No retries permitted until 2026-07-28 18:01:05.673947649 +0000 UTC m=+39.075492700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls") pod "dns-default-lwrff" (UID: "8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c") : secret "dns-default-metrics-tls" not found Jul 28 18:01:04.387568 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:04.387535 2563 generic.go:356] "Generic (PLEG): container finished" podID="9bd5a65a-bedf-4de1-a07a-610d3521385e" containerID="626d5c6942609cf874451ccd1178f1f2107d4fff734ba0898f0881fb20938dc7" exitCode=0 Jul 28 18:01:04.388414 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:04.387588 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd6vz" event={"ID":"9bd5a65a-bedf-4de1-a07a-610d3521385e","Type":"ContainerDied","Data":"626d5c6942609cf874451ccd1178f1f2107d4fff734ba0898f0881fb20938dc7"} Jul 28 18:01:04.422433 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:04.422398 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:05.392746 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:05.392710 2563 generic.go:356] "Generic (PLEG): container finished" podID="9bd5a65a-bedf-4de1-a07a-610d3521385e" containerID="8b934c3311e8fb698c5e5aa2f5c810a7bf351075f61da8754f11b5715943d3f3" exitCode=0 Jul 28 18:01:05.393148 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:05.392786 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd6vz" event={"ID":"9bd5a65a-bedf-4de1-a07a-610d3521385e","Type":"ContainerDied","Data":"8b934c3311e8fb698c5e5aa2f5c810a7bf351075f61da8754f11b5715943d3f3"} Jul 28 18:01:05.691769 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:05.691681 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:05.691943 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:05.691807 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:01:05.691943 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:05.691885 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls podName:8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c nodeName:}" failed. No retries permitted until 2026-07-28 18:01:09.691864137 +0000 UTC m=+43.093409199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls") pod "dns-default-lwrff" (UID: "8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c") : secret "dns-default-metrics-tls" not found Jul 28 18:01:05.910719 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:05.910676 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:05.985984 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:05.985891 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:06.397646 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:06.397616 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd6vz" event={"ID":"9bd5a65a-bedf-4de1-a07a-610d3521385e","Type":"ContainerStarted","Data":"aeb5985941c08d30315267ef31240178adc5c9da7041a229b5702799e64811eb"} Jul 28 18:01:06.424363 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:06.424314 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kd6vz" podStartSLOduration=10.319960812 podStartE2EDuration="39.424297428s" totalImagesPullingTime="29.104336616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:06.422891642 +0000 UTC m=+39.824436710" watchObservedRunningTime="2026-07-28 18:01:06.424297428 +0000 UTC m=+39.825842499" Jul 28 18:01:06.550909 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:06.550871 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:06.616429 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:06.616395 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:07.639203 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:07.639155 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:07.740752 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:07.740718 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:08.403644 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:08.403603 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nshmr" event={"ID":"1443152a-ab29-4506-b24d-820dbe81be9c","Type":"ContainerStarted","Data":"85a446a55ebefc061d6b1e639772a5e0c61b2a75bf1813e77bde3cad3abf83a3"} Jul 28 18:01:08.425934 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:08.425877 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nshmr" podStartSLOduration=3.197955987 podStartE2EDuration="7.42584397s" totalImagesPullingTime="4.227887983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:08.424482136 +0000 UTC m=+41.826027208" watchObservedRunningTime="2026-07-28 18:01:08.42584397 +0000 UTC m=+41.827389040" Jul 28 18:01:09.723168 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:09.723137 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:09.723535 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:09.723244 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:01:09.723535 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:09.723296 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls podName:8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c nodeName:}" failed. No retries permitted until 2026-07-28 18:01:17.723284123 +0000 UTC m=+51.124829172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls") pod "dns-default-lwrff" (UID: "8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c") : secret "dns-default-metrics-tls" not found Jul 28 18:01:17.780296 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:17.780257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:17.780777 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:17.780370 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:01:17.780777 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:17.780422 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls podName:8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c nodeName:}" failed. No retries permitted until 2026-07-28 18:01:33.780408666 +0000 UTC m=+67.181953715 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls") pod "dns-default-lwrff" (UID: "8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c") : secret "dns-default-metrics-tls" not found Jul 28 18:01:27.379416 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:27.379388 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6qr4" Jul 28 18:01:27.543365 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:27.543328 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:27.629010 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:27.628971 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:32.882347 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:32.882293 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:01:32.882347 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:32.882346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs\") pod \"network-metrics-daemon-8hvfx\" (UID: \"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75\") " pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:01:32.886372 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:32.886351 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 18:01:32.886372 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:32.886369 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 18:01:32.893092 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:32.893066 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 18:01:32.893157 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:32.893152 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs podName:6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75 nodeName:}" failed. No retries permitted until 2026-07-28 18:02:36.893133309 +0000 UTC m=+130.294678358 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs") pod "network-metrics-daemon-8hvfx" (UID: "6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75") : secret "metrics-daemon-secret" not found Jul 28 18:01:32.896542 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:32.896521 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2303d131-0afd-44ba-9f4e-75ded817669c-original-pull-secret\") pod \"global-pull-secret-syncer-4jk9v\" (UID: \"2303d131-0afd-44ba-9f4e-75ded817669c\") " pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:01:32.982806 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:32.982765 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v77v2\" (UniqueName: \"kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2\") pod \"network-check-target-bzrdk\" (UID: \"c3f3a583-1527-44a1-b22e-298a09afffdc\") " pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:01:32.986168 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:32.986146 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 18:01:32.996692 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:32.996669 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 18:01:33.007166 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:33.007136 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v77v2\" (UniqueName: \"kubernetes.io/projected/c3f3a583-1527-44a1-b22e-298a09afffdc-kube-api-access-v77v2\") pod \"network-check-target-bzrdk\" (UID: \"c3f3a583-1527-44a1-b22e-298a09afffdc\") " pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:01:33.144963 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:33.144880 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d6nqr\"" Jul 28 18:01:33.152441 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:33.152413 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:01:33.156395 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:33.156374 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jk9v" Jul 28 18:01:33.317958 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:33.317930 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bzrdk"] Jul 28 18:01:33.319032 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:33.319010 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4jk9v"] Jul 28 18:01:33.320771 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:01:33.320745 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f3a583_1527_44a1_b22e_298a09afffdc.slice/crio-a9a2ba27f6bdb3c27b6d553da5708cc87a7f6273e516301b369b87363577bdc7 WatchSource:0}: Error finding container a9a2ba27f6bdb3c27b6d553da5708cc87a7f6273e516301b369b87363577bdc7: Status 404 returned error can't find the container with id a9a2ba27f6bdb3c27b6d553da5708cc87a7f6273e516301b369b87363577bdc7 Jul 28 18:01:33.322127 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:01:33.322106 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2303d131_0afd_44ba_9f4e_75ded817669c.slice/crio-6290dc13e1b875adbcd32a5f9c7ca6b00ae684264db26357b13699fc051f6d6d WatchSource:0}: Error finding container 6290dc13e1b875adbcd32a5f9c7ca6b00ae684264db26357b13699fc051f6d6d: Status 404 returned error can't find the container with id 6290dc13e1b875adbcd32a5f9c7ca6b00ae684264db26357b13699fc051f6d6d Jul 28 18:01:33.464627 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:33.464531 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4jk9v" event={"ID":"2303d131-0afd-44ba-9f4e-75ded817669c","Type":"ContainerStarted","Data":"6290dc13e1b875adbcd32a5f9c7ca6b00ae684264db26357b13699fc051f6d6d"} Jul 28 18:01:33.467554 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:33.467522 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bzrdk" event={"ID":"c3f3a583-1527-44a1-b22e-298a09afffdc","Type":"ContainerStarted","Data":"a9a2ba27f6bdb3c27b6d553da5708cc87a7f6273e516301b369b87363577bdc7"} Jul 28 18:01:33.787596 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:33.787549 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:01:33.787872 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:33.787738 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:01:33.787872 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:33.787822 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls podName:8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c nodeName:}" failed. No retries permitted until 2026-07-28 18:02:05.787801236 +0000 UTC m=+99.189346300 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls") pod "dns-default-lwrff" (UID: "8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c") : secret "dns-default-metrics-tls" not found Jul 28 18:01:36.478834 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:36.478739 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bzrdk" event={"ID":"c3f3a583-1527-44a1-b22e-298a09afffdc","Type":"ContainerStarted","Data":"828c27206138d13d62ad384fa9053f4f1077d3f372db8dcf99d57f665324c3f1"} Jul 28 18:01:36.479299 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:36.478840 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:01:36.499027 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:36.498975 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bzrdk" podStartSLOduration=66.646355106 podStartE2EDuration="1m9.498955788s" totalImagesPullingTime="2.852600682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:36.49827336 +0000 UTC m=+69.899818431" watchObservedRunningTime="2026-07-28 18:01:36.498955788 +0000 UTC m=+69.900500858" Jul 28 18:01:38.484910 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:38.484814 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4jk9v" event={"ID":"2303d131-0afd-44ba-9f4e-75ded817669c","Type":"ContainerStarted","Data":"02c4be664e28068888ae897e4d22ac7a7766ce4d307fc0180ee2e5ff289b6005"} Jul 28 18:01:38.512971 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:38.512918 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4jk9v" podStartSLOduration=66.709628431 podStartE2EDuration="1m11.512899616s" totalImagesPullingTime="4.803271185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:38.512519682 +0000 UTC m=+71.914064753" watchObservedRunningTime="2026-07-28 18:01:38.512899616 +0000 UTC m=+71.914444683" Jul 28 18:01:42.115737 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.115701 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4"] Jul 28 18:01:42.117741 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.117725 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" Jul 28 18:01:42.121057 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.121029 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 28 18:01:42.121057 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.121064 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-m7rtp\"" Jul 28 18:01:42.122325 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.122306 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 28 18:01:42.122631 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.122611 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 28 18:01:42.122734 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.122654 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 28 18:01:42.123304 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.123286 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-bkjc4"] Jul 28 18:01:42.125235 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.125219 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-89f454f45-wmkhj"] Jul 28 18:01:42.125333 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.125316 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:42.127002 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.126981 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.127816 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.127797 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 28 18:01:42.128473 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.128458 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wq72x\"" Jul 28 18:01:42.130803 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.130775 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 28 18:01:42.131669 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.131399 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 28 18:01:42.131961 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.131802 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 28 18:01:42.131961 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.131824 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 28 18:01:42.131961 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.131872 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 28 18:01:42.132156 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.132127 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 28 18:01:42.133400 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.132598 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 28 18:01:42.133400 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.132788 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4"] Jul 28 18:01:42.133400 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.132809 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 28 18:01:42.133400 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.133054 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hvmwp\"" Jul 28 18:01:42.133702 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.133686 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 28 18:01:42.137772 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.137750 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 28 18:01:42.140516 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.140490 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-bkjc4"] Jul 28 18:01:42.154011 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.153969 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4aa5d4d8-f114-420b-a2cc-6618e2ba3c63-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4\" (UID: \"4aa5d4d8-f114-420b-a2cc-6618e2ba3c63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" Jul 28 18:01:42.154206 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.154049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a75f7c77-0525-45d0-b2e4-f0961bb7a096-serving-cert\") pod \"console-operator-584dcb6b54-bkjc4\" (UID: \"a75f7c77-0525-45d0-b2e4-f0961bb7a096\") " pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:42.154206 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.154079 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb8np\" (UniqueName: \"kubernetes.io/projected/a75f7c77-0525-45d0-b2e4-f0961bb7a096-kube-api-access-cb8np\") pod \"console-operator-584dcb6b54-bkjc4\" (UID: \"a75f7c77-0525-45d0-b2e4-f0961bb7a096\") " pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:42.154206 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.154111 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a75f7c77-0525-45d0-b2e4-f0961bb7a096-trusted-ca\") pod \"console-operator-584dcb6b54-bkjc4\" (UID: \"a75f7c77-0525-45d0-b2e4-f0961bb7a096\") " pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:42.154206 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.154132 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4aa5d4d8-f114-420b-a2cc-6618e2ba3c63-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4\" (UID: \"4aa5d4d8-f114-420b-a2cc-6618e2ba3c63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" Jul 28 18:01:42.154206 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.154155 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f46fv\" (UniqueName: \"kubernetes.io/projected/4aa5d4d8-f114-420b-a2cc-6618e2ba3c63-kube-api-access-f46fv\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4\" (UID: \"4aa5d4d8-f114-420b-a2cc-6618e2ba3c63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" Jul 28 18:01:42.154206 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.154180 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.154206 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.154202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-stats-auth\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.154525 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.154228 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a75f7c77-0525-45d0-b2e4-f0961bb7a096-config\") pod \"console-operator-584dcb6b54-bkjc4\" (UID: \"a75f7c77-0525-45d0-b2e4-f0961bb7a096\") " pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:42.154525 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.154253 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.154525 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.154282 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-default-certificate\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.154525 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.154308 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4g7p\" (UniqueName: \"kubernetes.io/projected/b957e2bd-d3d7-44ff-8556-b990cb83c073-kube-api-access-d4g7p\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.156342 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.156305 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-89f454f45-wmkhj"] Jul 28 18:01:42.255072 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.255035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a75f7c77-0525-45d0-b2e4-f0961bb7a096-serving-cert\") pod \"console-operator-584dcb6b54-bkjc4\" (UID: \"a75f7c77-0525-45d0-b2e4-f0961bb7a096\") " pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:42.255072 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.255080 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb8np\" (UniqueName: \"kubernetes.io/projected/a75f7c77-0525-45d0-b2e4-f0961bb7a096-kube-api-access-cb8np\") pod \"console-operator-584dcb6b54-bkjc4\" (UID: \"a75f7c77-0525-45d0-b2e4-f0961bb7a096\") " pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:42.255339 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.255102 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a75f7c77-0525-45d0-b2e4-f0961bb7a096-trusted-ca\") pod \"console-operator-584dcb6b54-bkjc4\" (UID: \"a75f7c77-0525-45d0-b2e4-f0961bb7a096\") " pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:42.255339 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.255119 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4aa5d4d8-f114-420b-a2cc-6618e2ba3c63-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4\" (UID: \"4aa5d4d8-f114-420b-a2cc-6618e2ba3c63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" Jul 28 18:01:42.255339 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.255136 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f46fv\" (UniqueName: \"kubernetes.io/projected/4aa5d4d8-f114-420b-a2cc-6618e2ba3c63-kube-api-access-f46fv\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4\" (UID: \"4aa5d4d8-f114-420b-a2cc-6618e2ba3c63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" Jul 28 18:01:42.255339 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.255152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.255339 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.255166 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-stats-auth\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.255339 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.255182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a75f7c77-0525-45d0-b2e4-f0961bb7a096-config\") pod \"console-operator-584dcb6b54-bkjc4\" (UID: \"a75f7c77-0525-45d0-b2e4-f0961bb7a096\") " pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:42.255339 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.255207 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.255339 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.255239 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-default-certificate\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.255339 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.255262 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g7p\" (UniqueName: \"kubernetes.io/projected/b957e2bd-d3d7-44ff-8556-b990cb83c073-kube-api-access-d4g7p\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.255339 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:42.255335 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle podName:b957e2bd-d3d7-44ff-8556-b990cb83c073 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:42.755312907 +0000 UTC m=+76.156857975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle") pod "router-default-89f454f45-wmkhj" (UID: "b957e2bd-d3d7-44ff-8556-b990cb83c073") : configmap references non-existent config key: service-ca.crt Jul 28 18:01:42.255834 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:42.255405 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 18:01:42.255834 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.255448 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4aa5d4d8-f114-420b-a2cc-6618e2ba3c63-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4\" (UID: \"4aa5d4d8-f114-420b-a2cc-6618e2ba3c63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" Jul 28 18:01:42.255834 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:42.255465 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs podName:b957e2bd-d3d7-44ff-8556-b990cb83c073 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:42.755448975 +0000 UTC m=+76.156994040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs") pod "router-default-89f454f45-wmkhj" (UID: "b957e2bd-d3d7-44ff-8556-b990cb83c073") : secret "router-metrics-certs-default" not found Jul 28 18:01:42.256040 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.255830 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4aa5d4d8-f114-420b-a2cc-6618e2ba3c63-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4\" (UID: \"4aa5d4d8-f114-420b-a2cc-6618e2ba3c63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" Jul 28 18:01:42.256522 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.256498 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a75f7c77-0525-45d0-b2e4-f0961bb7a096-config\") pod \"console-operator-584dcb6b54-bkjc4\" (UID: \"a75f7c77-0525-45d0-b2e4-f0961bb7a096\") " pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:42.256594 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.256583 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a75f7c77-0525-45d0-b2e4-f0961bb7a096-trusted-ca\") pod \"console-operator-584dcb6b54-bkjc4\" (UID: \"a75f7c77-0525-45d0-b2e4-f0961bb7a096\") " pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:42.258471 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.258447 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4aa5d4d8-f114-420b-a2cc-6618e2ba3c63-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4\" (UID: \"4aa5d4d8-f114-420b-a2cc-6618e2ba3c63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" Jul 28 18:01:42.258675 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.258655 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a75f7c77-0525-45d0-b2e4-f0961bb7a096-serving-cert\") pod \"console-operator-584dcb6b54-bkjc4\" (UID: \"a75f7c77-0525-45d0-b2e4-f0961bb7a096\") " pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:42.258756 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.258735 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-stats-auth\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.258792 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.258781 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-default-certificate\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.270533 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.270507 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4g7p\" (UniqueName: \"kubernetes.io/projected/b957e2bd-d3d7-44ff-8556-b990cb83c073-kube-api-access-d4g7p\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.270931 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.270907 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f46fv\" (UniqueName: \"kubernetes.io/projected/4aa5d4d8-f114-420b-a2cc-6618e2ba3c63-kube-api-access-f46fv\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4\" (UID: \"4aa5d4d8-f114-420b-a2cc-6618e2ba3c63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" Jul 28 18:01:42.271422 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.271406 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb8np\" (UniqueName: \"kubernetes.io/projected/a75f7c77-0525-45d0-b2e4-f0961bb7a096-kube-api-access-cb8np\") pod \"console-operator-584dcb6b54-bkjc4\" (UID: \"a75f7c77-0525-45d0-b2e4-f0961bb7a096\") " pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:42.322636 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.322607 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6br56"] Jul 28 18:01:42.325440 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.325423 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6br56" Jul 28 18:01:42.327563 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.327529 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:42.328092 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.328071 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 28 18:01:42.328466 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.328449 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 28 18:01:42.328556 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.328469 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ks6d5\"" Jul 28 18:01:42.337294 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.337271 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6br56"] Jul 28 18:01:42.355948 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.355911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv4ks\" (UniqueName: \"kubernetes.io/projected/5658cf68-03a2-48cb-bbb7-4196673cc9ab-kube-api-access-fv4ks\") pod \"volume-data-source-validator-549c6d54cf-6br56\" (UID: \"5658cf68-03a2-48cb-bbb7-4196673cc9ab\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6br56" Jul 28 18:01:42.400093 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.399993 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:42.427932 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.427903 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" Jul 28 18:01:42.437241 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.437220 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:42.457055 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.457023 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv4ks\" (UniqueName: \"kubernetes.io/projected/5658cf68-03a2-48cb-bbb7-4196673cc9ab-kube-api-access-fv4ks\") pod \"volume-data-source-validator-549c6d54cf-6br56\" (UID: \"5658cf68-03a2-48cb-bbb7-4196673cc9ab\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6br56" Jul 28 18:01:42.468697 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.468664 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv4ks\" (UniqueName: \"kubernetes.io/projected/5658cf68-03a2-48cb-bbb7-4196673cc9ab-kube-api-access-fv4ks\") pod \"volume-data-source-validator-549c6d54cf-6br56\" (UID: \"5658cf68-03a2-48cb-bbb7-4196673cc9ab\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6br56" Jul 28 18:01:42.564687 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.564655 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4"] Jul 28 18:01:42.567515 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:01:42.567486 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa5d4d8_f114_420b_a2cc_6618e2ba3c63.slice/crio-da35e637fbdc81194f4e77a23e10a272419484ae34c1c08dda6b5afbf1f3a7eb WatchSource:0}: Error finding container da35e637fbdc81194f4e77a23e10a272419484ae34c1c08dda6b5afbf1f3a7eb: Status 404 returned error can't find the container with id da35e637fbdc81194f4e77a23e10a272419484ae34c1c08dda6b5afbf1f3a7eb Jul 28 18:01:42.583991 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.583967 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-bkjc4"] Jul 28 18:01:42.587354 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:01:42.587327 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75f7c77_0525_45d0_b2e4_f0961bb7a096.slice/crio-3d75cb186629ded526659b1c93e5fa709e3660936a9d69a4122bde4643a0f1ed WatchSource:0}: Error finding container 3d75cb186629ded526659b1c93e5fa709e3660936a9d69a4122bde4643a0f1ed: Status 404 returned error can't find the container with id 3d75cb186629ded526659b1c93e5fa709e3660936a9d69a4122bde4643a0f1ed Jul 28 18:01:42.635232 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.635194 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6br56" Jul 28 18:01:42.758763 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.758724 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.758763 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.758765 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:42.758985 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:42.758884 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 18:01:42.758985 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:42.758926 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle podName:b957e2bd-d3d7-44ff-8556-b990cb83c073 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:43.758909235 +0000 UTC m=+77.160454303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle") pod "router-default-89f454f45-wmkhj" (UID: "b957e2bd-d3d7-44ff-8556-b990cb83c073") : configmap references non-existent config key: service-ca.crt Jul 28 18:01:42.758985 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:42.758952 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs podName:b957e2bd-d3d7-44ff-8556-b990cb83c073 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:43.75894481 +0000 UTC m=+77.160489860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs") pod "router-default-89f454f45-wmkhj" (UID: "b957e2bd-d3d7-44ff-8556-b990cb83c073") : secret "router-metrics-certs-default" not found Jul 28 18:01:42.764165 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:42.764141 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6br56"] Jul 28 18:01:42.766377 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:01:42.766356 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5658cf68_03a2_48cb_bbb7_4196673cc9ab.slice/crio-a2d3eaa5c2f57697ae0a9075a89e6c21951475767c28778e101f3f9fb74fb05b WatchSource:0}: Error finding container a2d3eaa5c2f57697ae0a9075a89e6c21951475767c28778e101f3f9fb74fb05b: Status 404 returned error can't find the container with id a2d3eaa5c2f57697ae0a9075a89e6c21951475767c28778e101f3f9fb74fb05b Jul 28 18:01:43.500465 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:43.500418 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" event={"ID":"4aa5d4d8-f114-420b-a2cc-6618e2ba3c63","Type":"ContainerStarted","Data":"da35e637fbdc81194f4e77a23e10a272419484ae34c1c08dda6b5afbf1f3a7eb"} Jul 28 18:01:43.502396 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:43.502367 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6br56" event={"ID":"5658cf68-03a2-48cb-bbb7-4196673cc9ab","Type":"ContainerStarted","Data":"a2d3eaa5c2f57697ae0a9075a89e6c21951475767c28778e101f3f9fb74fb05b"} Jul 28 18:01:43.503908 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:43.503878 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" event={"ID":"a75f7c77-0525-45d0-b2e4-f0961bb7a096","Type":"ContainerStarted","Data":"3d75cb186629ded526659b1c93e5fa709e3660936a9d69a4122bde4643a0f1ed"} Jul 28 18:01:43.767984 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:43.767891 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:43.767984 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:43.767956 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:43.768223 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:43.768071 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 18:01:43.768223 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:43.768085 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle podName:b957e2bd-d3d7-44ff-8556-b990cb83c073 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:45.768061698 +0000 UTC m=+79.169606765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle") pod "router-default-89f454f45-wmkhj" (UID: "b957e2bd-d3d7-44ff-8556-b990cb83c073") : configmap references non-existent config key: service-ca.crt Jul 28 18:01:43.768223 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:43.768123 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs podName:b957e2bd-d3d7-44ff-8556-b990cb83c073 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:45.768105935 +0000 UTC m=+79.169650986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs") pod "router-default-89f454f45-wmkhj" (UID: "b957e2bd-d3d7-44ff-8556-b990cb83c073") : secret "router-metrics-certs-default" not found Jul 28 18:01:44.507806 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:44.507773 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6br56" event={"ID":"5658cf68-03a2-48cb-bbb7-4196673cc9ab","Type":"ContainerStarted","Data":"ab8ba19a63da9b34066eb5f2a86d1d55f882e2f46dd376930959979a83eddc20"} Jul 28 18:01:44.509438 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:44.509408 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" event={"ID":"4aa5d4d8-f114-420b-a2cc-6618e2ba3c63","Type":"ContainerStarted","Data":"dd4ee3df2fab933911c8172084dc2a25984fc5863cc99188724c9f3005f7a69f"} Jul 28 18:01:44.526074 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:44.526015 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6br56" podStartSLOduration=1.458753838 podStartE2EDuration="2.525995783s" totalImagesPullingTime="1.067241945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:44.524697948 +0000 UTC m=+77.926243020" watchObservedRunningTime="2026-07-28 18:01:44.525995783 +0000 UTC m=+77.927540849" Jul 28 18:01:44.542284 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:44.542219 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" podStartSLOduration=0.757455995 podStartE2EDuration="2.54220531s" totalImagesPullingTime="1.784749315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:44.541090761 +0000 UTC m=+77.942635833" watchObservedRunningTime="2026-07-28 18:01:44.54220531 +0000 UTC m=+77.943750382" Jul 28 18:01:44.624253 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:44.624156 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:44.724601 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:44.724560 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:45.787053 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:45.787014 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:45.787514 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:45.787073 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:45.787514 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:45.787233 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle podName:b957e2bd-d3d7-44ff-8556-b990cb83c073 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:49.787213454 +0000 UTC m=+83.188758504 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle") pod "router-default-89f454f45-wmkhj" (UID: "b957e2bd-d3d7-44ff-8556-b990cb83c073") : configmap references non-existent config key: service-ca.crt Jul 28 18:01:45.787514 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:45.787263 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 18:01:45.787514 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:45.787344 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs podName:b957e2bd-d3d7-44ff-8556-b990cb83c073 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:49.7873294 +0000 UTC m=+83.188874449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs") pod "router-default-89f454f45-wmkhj" (UID: "b957e2bd-d3d7-44ff-8556-b990cb83c073") : secret "router-metrics-certs-default" not found Jul 28 18:01:46.020499 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.020467 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-qzh2g"] Jul 28 18:01:46.023689 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.023665 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qzh2g" Jul 28 18:01:46.028040 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.027830 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zb42s\"" Jul 28 18:01:46.028040 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.027831 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 28 18:01:46.028040 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.027932 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 28 18:01:46.029051 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.029017 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:46.036505 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.036478 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-qzh2g"] Jul 28 18:01:46.077239 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.077159 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5zgrr"] Jul 28 18:01:46.081960 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.081933 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.084802 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.084771 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 18:01:46.084967 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.084835 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 18:01:46.085037 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.084996 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 18:01:46.085402 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.085382 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fhj5f\"" Jul 28 18:01:46.085667 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.085651 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 18:01:46.088926 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.088900 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw45k\" (UniqueName: \"kubernetes.io/projected/e9245fcb-a04f-4d4f-987d-9f8292c72e9c-kube-api-access-xw45k\") pod \"migrator-6865c9967-qzh2g\" (UID: \"e9245fcb-a04f-4d4f-987d-9f8292c72e9c\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qzh2g" Jul 28 18:01:46.095651 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.095577 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5zgrr"] Jul 28 18:01:46.156864 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.156826 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:46.189608 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.189570 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8b16c371-448e-4258-b151-a12361f67bfe-crio-socket\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.189608 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.189610 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.189899 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.189745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw45k\" (UniqueName: \"kubernetes.io/projected/e9245fcb-a04f-4d4f-987d-9f8292c72e9c-kube-api-access-xw45k\") pod \"migrator-6865c9967-qzh2g\" (UID: \"e9245fcb-a04f-4d4f-987d-9f8292c72e9c\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qzh2g" Jul 28 18:01:46.189899 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.189801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.189899 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.189837 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b16c371-448e-4258-b151-a12361f67bfe-data-volume\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.189899 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.189888 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtt7d\" (UniqueName: \"kubernetes.io/projected/8b16c371-448e-4258-b151-a12361f67bfe-kube-api-access-dtt7d\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.200845 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.200810 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw45k\" (UniqueName: \"kubernetes.io/projected/e9245fcb-a04f-4d4f-987d-9f8292c72e9c-kube-api-access-xw45k\") pod \"migrator-6865c9967-qzh2g\" (UID: \"e9245fcb-a04f-4d4f-987d-9f8292c72e9c\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qzh2g" Jul 28 18:01:46.241188 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.241147 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:46.290832 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.290643 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.290832 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.290689 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b16c371-448e-4258-b151-a12361f67bfe-data-volume\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.290832 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.290723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtt7d\" (UniqueName: \"kubernetes.io/projected/8b16c371-448e-4258-b151-a12361f67bfe-kube-api-access-dtt7d\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.290832 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.290800 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8b16c371-448e-4258-b151-a12361f67bfe-crio-socket\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.290832 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:46.290797 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 18:01:46.291216 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:46.290907 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm podName:8b16c371-448e-4258-b151-a12361f67bfe nodeName:}" failed. No retries permitted until 2026-07-28 18:01:46.790887272 +0000 UTC m=+80.192432336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5zgrr" (UID: "8b16c371-448e-4258-b151-a12361f67bfe") : configmap "kube-rbac-proxy" not found Jul 28 18:01:46.291216 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.291112 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b16c371-448e-4258-b151-a12361f67bfe-data-volume\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.291216 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.291153 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.291375 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:46.291246 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:01:46.291375 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:46.291282 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls podName:8b16c371-448e-4258-b151-a12361f67bfe nodeName:}" failed. No retries permitted until 2026-07-28 18:01:46.791270395 +0000 UTC m=+80.192815444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5zgrr" (UID: "8b16c371-448e-4258-b151-a12361f67bfe") : secret "insights-runtime-extractor-tls" not found Jul 28 18:01:46.291375 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.291322 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8b16c371-448e-4258-b151-a12361f67bfe-crio-socket\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.304285 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.304244 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtt7d\" (UniqueName: \"kubernetes.io/projected/8b16c371-448e-4258-b151-a12361f67bfe-kube-api-access-dtt7d\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.334132 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.334043 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qzh2g" Jul 28 18:01:46.583246 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.583114 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:46.660592 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.660551 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-qzh2g"] Jul 28 18:01:46.663737 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:01:46.663708 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9245fcb_a04f_4d4f_987d_9f8292c72e9c.slice/crio-4f465539de7ff683685dd99dfc37d9776159287f11b789b77affe487db42f834 WatchSource:0}: Error finding container 4f465539de7ff683685dd99dfc37d9776159287f11b789b77affe487db42f834: Status 404 returned error can't find the container with id 4f465539de7ff683685dd99dfc37d9776159287f11b789b77affe487db42f834 Jul 28 18:01:46.667327 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.667128 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:46.794984 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.794934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.795388 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.795031 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:46.795388 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:46.795076 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 18:01:46.795388 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:46.795162 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm podName:8b16c371-448e-4258-b151-a12361f67bfe nodeName:}" failed. No retries permitted until 2026-07-28 18:01:47.795144251 +0000 UTC m=+81.196689323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5zgrr" (UID: "8b16c371-448e-4258-b151-a12361f67bfe") : configmap "kube-rbac-proxy" not found Jul 28 18:01:46.795388 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:46.795171 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:01:46.795388 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:46.795225 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls podName:8b16c371-448e-4258-b151-a12361f67bfe nodeName:}" failed. No retries permitted until 2026-07-28 18:01:47.795213182 +0000 UTC m=+81.196758232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5zgrr" (UID: "8b16c371-448e-4258-b151-a12361f67bfe") : secret "insights-runtime-extractor-tls" not found Jul 28 18:01:46.982082 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:46.981928 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:47.065208 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:47.065165 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:47.278092 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:47.278055 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:47.378322 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:47.378103 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:47.519701 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:47.519665 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qzh2g" event={"ID":"e9245fcb-a04f-4d4f-987d-9f8292c72e9c","Type":"ContainerStarted","Data":"4f465539de7ff683685dd99dfc37d9776159287f11b789b77affe487db42f834"} Jul 28 18:01:47.521596 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:47.521569 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bkjc4_a75f7c77-0525-45d0-b2e4-f0961bb7a096/console-operator/0.log" Jul 28 18:01:47.521755 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:47.521617 2563 generic.go:356] "Generic (PLEG): container finished" podID="a75f7c77-0525-45d0-b2e4-f0961bb7a096" containerID="c26b40f8ac24df53d9fa69a01551839734a93e75b53dffc54f456b9a0be0f7e6" exitCode=255 Jul 28 18:01:47.521755 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:47.521676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" event={"ID":"a75f7c77-0525-45d0-b2e4-f0961bb7a096","Type":"ContainerDied","Data":"c26b40f8ac24df53d9fa69a01551839734a93e75b53dffc54f456b9a0be0f7e6"} Jul 28 18:01:47.521996 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:47.521973 2563 scope.go:117] "RemoveContainer" containerID="c26b40f8ac24df53d9fa69a01551839734a93e75b53dffc54f456b9a0be0f7e6" Jul 28 18:01:47.804626 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:47.804582 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:47.805113 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:47.804693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:47.805113 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:47.804725 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 18:01:47.805113 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:47.804801 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm podName:8b16c371-448e-4258-b151-a12361f67bfe nodeName:}" failed. No retries permitted until 2026-07-28 18:01:49.804781721 +0000 UTC m=+83.206326773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5zgrr" (UID: "8b16c371-448e-4258-b151-a12361f67bfe") : configmap "kube-rbac-proxy" not found Jul 28 18:01:47.805113 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:47.804828 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:01:47.805113 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:47.804909 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls podName:8b16c371-448e-4258-b151-a12361f67bfe nodeName:}" failed. No retries permitted until 2026-07-28 18:01:49.804892146 +0000 UTC m=+83.206437198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5zgrr" (UID: "8b16c371-448e-4258-b151-a12361f67bfe") : secret "insights-runtime-extractor-tls" not found Jul 28 18:01:48.526581 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:48.526554 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bkjc4_a75f7c77-0525-45d0-b2e4-f0961bb7a096/console-operator/1.log" Jul 28 18:01:48.527008 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:48.526993 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bkjc4_a75f7c77-0525-45d0-b2e4-f0961bb7a096/console-operator/0.log" Jul 28 18:01:48.527065 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:48.527027 2563 generic.go:356] "Generic (PLEG): container finished" podID="a75f7c77-0525-45d0-b2e4-f0961bb7a096" containerID="a4795e06617fff2aec6a61683cd37274be4844d5af1834ddafa02acb298bd247" exitCode=255 Jul 28 18:01:48.527149 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:48.527125 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" event={"ID":"a75f7c77-0525-45d0-b2e4-f0961bb7a096","Type":"ContainerDied","Data":"a4795e06617fff2aec6a61683cd37274be4844d5af1834ddafa02acb298bd247"} Jul 28 18:01:48.527205 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:48.527190 2563 scope.go:117] "RemoveContainer" containerID="c26b40f8ac24df53d9fa69a01551839734a93e75b53dffc54f456b9a0be0f7e6" Jul 28 18:01:48.527356 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:48.527327 2563 scope.go:117] "RemoveContainer" containerID="a4795e06617fff2aec6a61683cd37274be4844d5af1834ddafa02acb298bd247" Jul 28 18:01:48.527558 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:48.527537 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-bkjc4_openshift-console-operator(a75f7c77-0525-45d0-b2e4-f0961bb7a096)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" podUID="a75f7c77-0525-45d0-b2e4-f0961bb7a096" Jul 28 18:01:48.529038 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:48.529015 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qzh2g" event={"ID":"e9245fcb-a04f-4d4f-987d-9f8292c72e9c","Type":"ContainerStarted","Data":"6cda834679fc45d3b3afb0d7233147380f0be564a227ab2ae3e886cc55bfe364"} Jul 28 18:01:48.529125 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:48.529063 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qzh2g" event={"ID":"e9245fcb-a04f-4d4f-987d-9f8292c72e9c","Type":"ContainerStarted","Data":"0e40b3f19a76c5d4158db081e23278cc5abe58397f2c8ec93092706c4d619c54"} Jul 28 18:01:48.566014 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:48.565950 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qzh2g" podStartSLOduration=1.5363042139999998 podStartE2EDuration="2.56592997s" totalImagesPullingTime="1.029625756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:48.565865431 +0000 UTC m=+81.967410494" watchObservedRunningTime="2026-07-28 18:01:48.56592997 +0000 UTC m=+81.967475042" Jul 28 18:01:48.645745 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:48.645711 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:48.714310 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:48.714275 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:48.875166 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:48.875087 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c665d_f0b28227-f549-4efc-8400-8b6e593bdbc7/dns-node-resolver/0.log" Jul 28 18:01:48.897527 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:48.897487 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:49.535658 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:49.535621 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bkjc4_a75f7c77-0525-45d0-b2e4-f0961bb7a096/console-operator/1.log" Jul 28 18:01:49.536032 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:49.536016 2563 scope.go:117] "RemoveContainer" containerID="a4795e06617fff2aec6a61683cd37274be4844d5af1834ddafa02acb298bd247" Jul 28 18:01:49.536194 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:49.536176 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-bkjc4_openshift-console-operator(a75f7c77-0525-45d0-b2e4-f0961bb7a096)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" podUID="a75f7c77-0525-45d0-b2e4-f0961bb7a096" Jul 28 18:01:49.821022 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:49.820922 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:49.821022 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:49.820981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:49.821022 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:49.821007 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:49.821022 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:49.821022 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:49.821283 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:49.821075 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:01:49.821283 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:49.821100 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 18:01:49.821283 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:49.821137 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 18:01:49.821283 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:49.821162 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls podName:8b16c371-448e-4258-b151-a12361f67bfe nodeName:}" failed. No retries permitted until 2026-07-28 18:01:53.821139513 +0000 UTC m=+87.222684584 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5zgrr" (UID: "8b16c371-448e-4258-b151-a12361f67bfe") : secret "insights-runtime-extractor-tls" not found Jul 28 18:01:49.821283 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:49.821182 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm podName:8b16c371-448e-4258-b151-a12361f67bfe nodeName:}" failed. No retries permitted until 2026-07-28 18:01:53.821171641 +0000 UTC m=+87.222716691 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5zgrr" (UID: "8b16c371-448e-4258-b151-a12361f67bfe") : configmap "kube-rbac-proxy" not found Jul 28 18:01:49.821283 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:49.821193 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle podName:b957e2bd-d3d7-44ff-8556-b990cb83c073 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:57.821187538 +0000 UTC m=+91.222732586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle") pod "router-default-89f454f45-wmkhj" (UID: "b957e2bd-d3d7-44ff-8556-b990cb83c073") : configmap references non-existent config key: service-ca.crt Jul 28 18:01:49.821283 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:49.821202 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs podName:b957e2bd-d3d7-44ff-8556-b990cb83c073 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:57.821197535 +0000 UTC m=+91.222742584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs") pod "router-default-89f454f45-wmkhj" (UID: "b957e2bd-d3d7-44ff-8556-b990cb83c073") : secret "router-metrics-certs-default" not found Jul 28 18:01:49.903024 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:49.902994 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:50.073207 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:50.073130 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vkfbb_985f20a7-3708-4e65-813e-6c35a729145e/node-ca/0.log" Jul 28 18:01:50.653951 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:50.653913 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:50.673067 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:50.673027 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nshmr_1443152a-ab29-4506-b24d-820dbe81be9c/serve-healthcheck-canary/0.log" Jul 28 18:01:50.753794 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:50.753758 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:50.913665 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:50.913579 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:51.025806 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:51.025777 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:51.073933 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:51.073903 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-qzh2g_e9245fcb-a04f-4d4f-987d-9f8292c72e9c/migrator/0.log" Jul 28 18:01:51.120590 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:51.120556 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:51.273317 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:51.273292 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-qzh2g_e9245fcb-a04f-4d4f-987d-9f8292c72e9c/graceful-termination/0.log" Jul 28 18:01:51.326662 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:51.326630 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:51.480278 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:51.480245 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4_4aa5d4d8-f114-420b-a2cc-6618e2ba3c63/kube-storage-version-migrator-operator/0.log" Jul 28 18:01:51.931120 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:51.931080 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:52.437573 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:52.437519 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:52.437787 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:52.437605 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:01:52.438037 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:52.438020 2563 scope.go:117] "RemoveContainer" containerID="a4795e06617fff2aec6a61683cd37274be4844d5af1834ddafa02acb298bd247" Jul 28 18:01:52.438217 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:52.438195 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-bkjc4_openshift-console-operator(a75f7c77-0525-45d0-b2e4-f0961bb7a096)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" podUID="a75f7c77-0525-45d0-b2e4-f0961bb7a096" Jul 28 18:01:52.532408 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:52.532375 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:52.789597 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:52.789566 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:52.932624 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:52.932585 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:53.326454 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:53.326412 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:53.527992 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:53.527956 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:53.853732 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:53.853701 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:53.853931 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:53.853765 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:01:53.853931 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:53.853828 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 18:01:53.853931 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:53.853879 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:01:53.853931 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:53.853923 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm podName:8b16c371-448e-4258-b151-a12361f67bfe nodeName:}" failed. No retries permitted until 2026-07-28 18:02:01.85390593 +0000 UTC m=+95.255450982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5zgrr" (UID: "8b16c371-448e-4258-b151-a12361f67bfe") : configmap "kube-rbac-proxy" not found Jul 28 18:01:53.854066 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:01:53.853940 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls podName:8b16c371-448e-4258-b151-a12361f67bfe nodeName:}" failed. No retries permitted until 2026-07-28 18:02:01.853933275 +0000 UTC m=+95.255478324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5zgrr" (UID: "8b16c371-448e-4258-b151-a12361f67bfe") : secret "insights-runtime-extractor-tls" not found Jul 28 18:01:54.134453 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:54.134369 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:55.459191 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:55.459152 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:55.559713 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:55.559673 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:55.730870 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:55.730768 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:55.803975 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:55.803933 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:56.147991 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:56.147957 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:56.324747 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:56.324716 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:56.931645 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:56.931614 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:57.326602 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:57.326567 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:57.391078 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:57.391046 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:57.530216 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:57.530177 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:57.888149 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:57.888112 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:57.888149 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:57.888152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:57.888786 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:57.888766 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b957e2bd-d3d7-44ff-8556-b990cb83c073-service-ca-bundle\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:57.890773 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:57.890751 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b957e2bd-d3d7-44ff-8556-b990cb83c073-metrics-certs\") pod \"router-default-89f454f45-wmkhj\" (UID: \"b957e2bd-d3d7-44ff-8556-b990cb83c073\") " pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:57.938528 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:57.938477 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:58.042698 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:58.042659 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:58.187308 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:58.187215 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-89f454f45-wmkhj"] Jul 28 18:01:58.189974 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:01:58.189940 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb957e2bd_d3d7_44ff_8556_b990cb83c073.slice/crio-3e4d3fcf6884324aa148696906421c5f119977be6df478760761bf6227f56bd6 WatchSource:0}: Error finding container 3e4d3fcf6884324aa148696906421c5f119977be6df478760761bf6227f56bd6: Status 404 returned error can't find the container with id 3e4d3fcf6884324aa148696906421c5f119977be6df478760761bf6227f56bd6 Jul 28 18:01:58.531481 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:58.531449 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:58.564805 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:58.564769 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-89f454f45-wmkhj" event={"ID":"b957e2bd-d3d7-44ff-8556-b990cb83c073","Type":"ContainerStarted","Data":"9d22d99fa872c1c32ec713f2b83a966b395938c2dc157b38cb873768c4e0c0c9"} Jul 28 18:01:58.564992 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:58.564827 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-89f454f45-wmkhj" event={"ID":"b957e2bd-d3d7-44ff-8556-b990cb83c073","Type":"ContainerStarted","Data":"3e4d3fcf6884324aa148696906421c5f119977be6df478760761bf6227f56bd6"} Jul 28 18:01:58.592172 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:58.592118 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-89f454f45-wmkhj" podStartSLOduration=16.592101096 podStartE2EDuration="16.592101096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:58.591541232 +0000 UTC m=+91.993086307" watchObservedRunningTime="2026-07-28 18:01:58.592101096 +0000 UTC m=+91.993646167" Jul 28 18:01:59.043401 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:59.043368 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:59.046085 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:59.046058 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:59.567929 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:59.567888 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:59.569194 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:59.569170 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-89f454f45-wmkhj" Jul 28 18:01:59.877383 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:59.877289 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:59.979082 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:01:59.979050 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:00.325766 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:00.325735 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:00.588994 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:00.588911 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:00.691587 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:00.691547 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:00.788871 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:00.788817 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:00.926664 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:00.926575 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:01.127757 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:01.127723 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:01.330781 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:01.330741 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:01.738059 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:01.737970 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:01.858624 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:01.858590 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:01.922829 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:01.922796 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:02:01.922949 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:01.922868 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:02:01.923366 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:01.923341 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b16c371-448e-4258-b151-a12361f67bfe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:02:01.925353 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:01.925337 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b16c371-448e-4258-b151-a12361f67bfe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5zgrr\" (UID: \"8b16c371-448e-4258-b151-a12361f67bfe\") " pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:02:01.992800 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:01.992680 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5zgrr" Jul 28 18:02:02.128658 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:02.128525 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5zgrr"] Jul 28 18:02:02.131794 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:02:02.131765 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b16c371_448e_4258_b151_a12361f67bfe.slice/crio-5175b65d369d3120c99a175a01174f9092baafdcf329145a9a6d04b1e0c9b69a WatchSource:0}: Error finding container 5175b65d369d3120c99a175a01174f9092baafdcf329145a9a6d04b1e0c9b69a: Status 404 returned error can't find the container with id 5175b65d369d3120c99a175a01174f9092baafdcf329145a9a6d04b1e0c9b69a Jul 28 18:02:02.579830 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:02.579777 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5zgrr" event={"ID":"8b16c371-448e-4258-b151-a12361f67bfe","Type":"ContainerStarted","Data":"5175b65d369d3120c99a175a01174f9092baafdcf329145a9a6d04b1e0c9b69a"} Jul 28 18:02:05.143378 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:05.143335 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:05.235008 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:05.234980 2563 scope.go:117] "RemoveContainer" containerID="a4795e06617fff2aec6a61683cd37274be4844d5af1834ddafa02acb298bd247" Jul 28 18:02:05.244738 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:05.244698 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:05.856067 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:05.856024 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:02:05.858936 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:05.858907 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c-metrics-tls\") pod \"dns-default-lwrff\" (UID: \"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c\") " pod="openshift-dns/dns-default-lwrff" Jul 28 18:02:05.870056 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:05.870020 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-68ztc\"" Jul 28 18:02:05.877678 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:05.877637 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lwrff" Jul 28 18:02:07.067606 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:07.067576 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lwrff"] Jul 28 18:02:07.070650 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:02:07.070293 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3ef4f9_ddf8_4714_85e5_7f680dc5f81c.slice/crio-f9a2458a44e01780f9190662c5359b746387353e85605922c1c4e56bbb60f0e5 WatchSource:0}: Error finding container f9a2458a44e01780f9190662c5359b746387353e85605922c1c4e56bbb60f0e5: Status 404 returned error can't find the container with id f9a2458a44e01780f9190662c5359b746387353e85605922c1c4e56bbb60f0e5 Jul 28 18:02:07.484277 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:07.484247 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bzrdk" Jul 28 18:02:07.599996 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:07.599952 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5zgrr" event={"ID":"8b16c371-448e-4258-b151-a12361f67bfe","Type":"ContainerStarted","Data":"02e738410739882dd5b3ee6f7933d915f1b25579fd3ec465558c3a2cbbeb047a"} Jul 28 18:02:07.602009 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:07.601970 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lwrff" event={"ID":"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c","Type":"ContainerStarted","Data":"f9a2458a44e01780f9190662c5359b746387353e85605922c1c4e56bbb60f0e5"} Jul 28 18:02:07.604740 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:07.604683 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bkjc4_a75f7c77-0525-45d0-b2e4-f0961bb7a096/console-operator/1.log" Jul 28 18:02:07.604740 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:07.604738 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" event={"ID":"a75f7c77-0525-45d0-b2e4-f0961bb7a096","Type":"ContainerStarted","Data":"573c3eeb705a6875fcde7bf92d2f9b99c5c88aaf87723fd1b6cacc360d7a23b3"} Jul 28 18:02:07.605159 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:07.605109 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:02:07.630094 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:07.630027 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" podStartSLOduration=21.642769972 podStartE2EDuration="25.630003449s" totalImagesPullingTime="3.987233477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:07.628235569 +0000 UTC m=+101.029780643" watchObservedRunningTime="2026-07-28 18:02:07.630003449 +0000 UTC m=+101.031548521" Jul 28 18:02:07.919923 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:07.919845 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-bkjc4" Jul 28 18:02:09.176663 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:09.176616 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:09.277394 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:09.277355 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:09.608404 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:09.608368 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:09.804469 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:09.804424 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:09.908489 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:09.908403 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:10.080635 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:10.080597 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2qrv2"] Jul 28 18:02:10.201708 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:10.201604 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2qrv2"] Jul 28 18:02:10.202137 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:10.201732 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2qrv2" Jul 28 18:02:10.206789 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:10.206741 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ftgvv\"" Jul 28 18:02:10.207687 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:10.207153 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 28 18:02:10.210062 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:10.209955 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:10.298381 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:10.298334 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6714a25c-5a51-462e-9caf-799337cb5695-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-2qrv2\" (UID: \"6714a25c-5a51-462e-9caf-799337cb5695\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2qrv2" Jul 28 18:02:10.304031 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:10.303994 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:10.399019 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:10.398981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6714a25c-5a51-462e-9caf-799337cb5695-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-2qrv2\" (UID: \"6714a25c-5a51-462e-9caf-799337cb5695\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2qrv2" Jul 28 18:02:10.401604 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:10.401573 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6714a25c-5a51-462e-9caf-799337cb5695-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-2qrv2\" (UID: \"6714a25c-5a51-462e-9caf-799337cb5695\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2qrv2" Jul 28 18:02:10.518598 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:10.518511 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2qrv2" Jul 28 18:02:11.418357 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:11.418319 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:11.520489 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:11.520444 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:11.557868 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:11.557787 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2qrv2"] Jul 28 18:02:11.563506 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:02:11.563477 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6714a25c_5a51_462e_9caf_799337cb5695.slice/crio-bf5e281aad43b091e8c39f29434d6a7e3cb8c39d613273b6b512348a77bda42e WatchSource:0}: Error finding container bf5e281aad43b091e8c39f29434d6a7e3cb8c39d613273b6b512348a77bda42e: Status 404 returned error can't find the container with id bf5e281aad43b091e8c39f29434d6a7e3cb8c39d613273b6b512348a77bda42e Jul 28 18:02:11.621929 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:11.621835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2qrv2" event={"ID":"6714a25c-5a51-462e-9caf-799337cb5695","Type":"ContainerStarted","Data":"bf5e281aad43b091e8c39f29434d6a7e3cb8c39d613273b6b512348a77bda42e"} Jul 28 18:02:11.623559 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:11.623524 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5zgrr" event={"ID":"8b16c371-448e-4258-b151-a12361f67bfe","Type":"ContainerStarted","Data":"a74ab8d2c38ca8b123bd354d9d688f05e277e4dd0b10080dc2f3a57ebf81be49"} Jul 28 18:02:11.625303 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:11.625266 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lwrff" event={"ID":"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c","Type":"ContainerStarted","Data":"21ad55b7ecd8f2cb156c403e0477424bbd32e97c3abd4663979e9e8488189e98"} Jul 28 18:02:11.625427 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:11.625319 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lwrff" event={"ID":"8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c","Type":"ContainerStarted","Data":"544f138a41b711104b5fe95c57086fe2d6dd65bb6ba119adc30821b623eb0398"} Jul 28 18:02:11.625487 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:11.625438 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lwrff" Jul 28 18:02:11.645293 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:11.645241 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lwrff" podStartSLOduration=66.30479228 podStartE2EDuration="1m10.645222203s" totalImagesPullingTime="4.340429923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:11.643372687 +0000 UTC m=+105.044917758" watchObservedRunningTime="2026-07-28 18:02:11.645222203 +0000 UTC m=+105.046767274" Jul 28 18:02:13.524064 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.524024 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:13.601020 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.600977 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:13.633946 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.633901 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2qrv2" event={"ID":"6714a25c-5a51-462e-9caf-799337cb5695","Type":"ContainerStarted","Data":"1fc71b0a815bc017ffbf08b6941b16fd0dec28cc3fc0be5a761f718da95774a8"} Jul 28 18:02:13.634125 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.634103 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2qrv2" Jul 28 18:02:13.640442 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.640418 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2qrv2" Jul 28 18:02:13.653629 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.653576 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-2qrv2" podStartSLOduration=2.355962645 podStartE2EDuration="3.653560294s" totalImagesPullingTime="1.297597649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:13.65279163 +0000 UTC m=+107.054336701" watchObservedRunningTime="2026-07-28 18:02:13.653560294 +0000 UTC m=+107.055105366" Jul 28 18:02:13.811895 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.811779 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:13.859327 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.859293 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-dn7nx"] Jul 28 18:02:13.862812 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.862790 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:13.866144 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.866119 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-phgxp\"" Jul 28 18:02:13.866296 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.866152 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 18:02:13.866350 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.866323 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 28 18:02:13.866567 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.866543 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 18:02:13.866629 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.866598 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 28 18:02:13.866679 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.866624 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 18:02:13.872309 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.872284 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-dn7nx"] Jul 28 18:02:13.877645 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.877619 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:13.925816 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.925770 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-dn7nx\" (UID: \"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:13.926016 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.925908 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmww4\" (UniqueName: \"kubernetes.io/projected/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-kube-api-access-zmww4\") pod \"prometheus-operator-84d69f794d-dn7nx\" (UID: \"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:13.926016 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.925954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-dn7nx\" (UID: \"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:13.926016 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:13.925992 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-dn7nx\" (UID: \"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:14.026504 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:14.026465 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmww4\" (UniqueName: \"kubernetes.io/projected/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-kube-api-access-zmww4\") pod \"prometheus-operator-84d69f794d-dn7nx\" (UID: \"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:14.026702 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:14.026519 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-dn7nx\" (UID: \"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:14.026702 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:14.026556 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-dn7nx\" (UID: \"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:14.026702 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:14.026615 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-dn7nx\" (UID: \"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:14.026702 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:02:14.026685 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 28 18:02:14.026930 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:02:14.026756 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-prometheus-operator-tls podName:461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11 nodeName:}" failed. No retries permitted until 2026-07-28 18:02:14.526737289 +0000 UTC m=+107.928282339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-dn7nx" (UID: "461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11") : secret "prometheus-operator-tls" not found Jul 28 18:02:14.027355 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:14.027323 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-dn7nx\" (UID: \"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:14.029515 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:14.029490 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-dn7nx\" (UID: \"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:14.037519 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:14.037490 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmww4\" (UniqueName: \"kubernetes.io/projected/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-kube-api-access-zmww4\") pod \"prometheus-operator-84d69f794d-dn7nx\" (UID: \"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:14.531172 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:14.531125 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-dn7nx\" (UID: \"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:14.531634 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:02:14.531295 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 28 18:02:14.531634 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:02:14.531369 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-prometheus-operator-tls podName:461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11 nodeName:}" failed. No retries permitted until 2026-07-28 18:02:15.531351205 +0000 UTC m=+108.932896253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-dn7nx" (UID: "461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11") : secret "prometheus-operator-tls" not found Jul 28 18:02:14.924609 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:14.924526 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:15.317826 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:15.317777 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:15.403969 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:15.403938 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:15.539176 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:15.539132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-dn7nx\" (UID: \"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:15.541679 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:15.541657 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-dn7nx\" (UID: \"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:15.643671 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:15.643579 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5zgrr" event={"ID":"8b16c371-448e-4258-b151-a12361f67bfe","Type":"ContainerStarted","Data":"61bfe99c0cd01bd847f62375643192aa39a34f0973ef6fe7300f0a31272bce61"} Jul 28 18:02:15.664149 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:15.664098 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5zgrr" podStartSLOduration=16.551846643 podStartE2EDuration="29.664080795s" totalImagesPullingTime="13.112234152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:01:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:15.663445417 +0000 UTC m=+109.064990488" watchObservedRunningTime="2026-07-28 18:02:15.664080795 +0000 UTC m=+109.065625866" Jul 28 18:02:15.674677 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:15.674643 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" Jul 28 18:02:15.811695 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:15.811610 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-dn7nx"] Jul 28 18:02:15.814295 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:02:15.814265 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod461779e0_d8c8_4d0f_8e5b_e55f5bdaaa11.slice/crio-906c0e61e39ce597a2741a481d3c6ce439dc6a1b0ae583af2c236d5ad22b75c4 WatchSource:0}: Error finding container 906c0e61e39ce597a2741a481d3c6ce439dc6a1b0ae583af2c236d5ad22b75c4: Status 404 returned error can't find the container with id 906c0e61e39ce597a2741a481d3c6ce439dc6a1b0ae583af2c236d5ad22b75c4 Jul 28 18:02:16.517888 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:16.517828 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:16.578000 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:16.577964 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:16.648305 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:16.648265 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" event={"ID":"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11","Type":"ContainerStarted","Data":"906c0e61e39ce597a2741a481d3c6ce439dc6a1b0ae583af2c236d5ad22b75c4"} Jul 28 18:02:17.653804 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:17.653714 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" event={"ID":"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11","Type":"ContainerStarted","Data":"9b64eb41d9106068835d857be051fd5e6308aedbefe5bf240c02d9818885d4dd"} Jul 28 18:02:17.653804 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:17.653772 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" event={"ID":"461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11","Type":"ContainerStarted","Data":"c1ef42366cf96128cf8329a7b88c5f779d3d7619b4c93aca2d4379d85ca8613e"} Jul 28 18:02:17.687179 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:17.687117 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-dn7nx" podStartSLOduration=3.151191898 podStartE2EDuration="4.687098564s" totalImagesPullingTime="1.535906666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:17.685327857 +0000 UTC m=+111.086872940" watchObservedRunningTime="2026-07-28 18:02:17.687098564 +0000 UTC m=+111.088643655" Jul 28 18:02:17.709409 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:17.709374 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:18.968141 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:18.968107 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:19.203610 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.203570 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:19.234018 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.233929 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp"] Jul 28 18:02:19.236261 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.236234 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" Jul 28 18:02:19.239221 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.239199 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 28 18:02:19.239330 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.239237 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 28 18:02:19.239330 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.239210 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gdffq\"" Jul 28 18:02:19.254642 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.254610 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp"] Jul 28 18:02:19.265613 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.265580 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk"] Jul 28 18:02:19.268025 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.267999 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.273306 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.273275 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 28 18:02:19.273928 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.273660 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 28 18:02:19.274153 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.273729 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 28 18:02:19.274320 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.273791 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-297gs\"" Jul 28 18:02:19.277762 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.277737 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vgvp5"] Jul 28 18:02:19.281300 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.281279 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.284120 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.284047 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 18:02:19.284120 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.284065 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 18:02:19.284451 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.284434 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tnvgf\"" Jul 28 18:02:19.284696 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.284679 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 18:02:19.285325 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.285300 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk"] Jul 28 18:02:19.292278 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.292240 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:19.364550 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.364514 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:19.368053 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368027 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-wtmp\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.368204 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368071 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f946eeb-7433-4334-ac05-eccda77b046e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-kwzpp\" (UID: \"6f946eeb-7433-4334-ac05-eccda77b046e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" Jul 28 18:02:19.368204 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368097 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc5hq\" (UniqueName: \"kubernetes.io/projected/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-kube-api-access-jc5hq\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.368204 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368167 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.368366 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368213 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-textfile\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.368366 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.368366 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368273 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f946eeb-7433-4334-ac05-eccda77b046e-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-kwzpp\" (UID: \"6f946eeb-7433-4334-ac05-eccda77b046e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" Jul 28 18:02:19.368366 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.368366 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368327 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.368600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f946eeb-7433-4334-ac05-eccda77b046e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-kwzpp\" (UID: \"6f946eeb-7433-4334-ac05-eccda77b046e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" Jul 28 18:02:19.368600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.368600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368451 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/354d007d-704b-4a8f-be73-9c6cf3a681d9-sys\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.368600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368480 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-tls\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.368600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368525 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/354d007d-704b-4a8f-be73-9c6cf3a681d9-metrics-client-ca\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.368600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368581 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/354d007d-704b-4a8f-be73-9c6cf3a681d9-root\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.368930 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj2xt\" (UniqueName: \"kubernetes.io/projected/354d007d-704b-4a8f-be73-9c6cf3a681d9-kube-api-access-fj2xt\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.368930 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.368930 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368665 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.368930 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.368738 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf44s\" (UniqueName: \"kubernetes.io/projected/6f946eeb-7433-4334-ac05-eccda77b046e-kube-api-access-gf44s\") pod \"openshift-state-metrics-b8f49f5c6-kwzpp\" (UID: \"6f946eeb-7433-4334-ac05-eccda77b046e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" Jul 28 18:02:19.470042 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470013 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.470042 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/354d007d-704b-4a8f-be73-9c6cf3a681d9-sys\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.470281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470064 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-tls\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.470281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470086 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/354d007d-704b-4a8f-be73-9c6cf3a681d9-metrics-client-ca\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.470281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470114 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/354d007d-704b-4a8f-be73-9c6cf3a681d9-root\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.470281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470136 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj2xt\" (UniqueName: \"kubernetes.io/projected/354d007d-704b-4a8f-be73-9c6cf3a681d9-kube-api-access-fj2xt\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.470281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470145 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/354d007d-704b-4a8f-be73-9c6cf3a681d9-sys\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.470281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470166 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.470281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470197 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.470281 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:02:19.470212 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 18:02:19.470281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470197 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/354d007d-704b-4a8f-be73-9c6cf3a681d9-root\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.470281 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf44s\" (UniqueName: \"kubernetes.io/projected/6f946eeb-7433-4334-ac05-eccda77b046e-kube-api-access-gf44s\") pod \"openshift-state-metrics-b8f49f5c6-kwzpp\" (UID: \"6f946eeb-7433-4334-ac05-eccda77b046e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" Jul 28 18:02:19.470824 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:02:19.470296 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-tls podName:354d007d-704b-4a8f-be73-9c6cf3a681d9 nodeName:}" failed. No retries permitted until 2026-07-28 18:02:19.97027752 +0000 UTC m=+113.371822570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-tls") pod "node-exporter-vgvp5" (UID: "354d007d-704b-4a8f-be73-9c6cf3a681d9") : secret "node-exporter-tls" not found Jul 28 18:02:19.470824 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470333 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-wtmp\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.470824 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f946eeb-7433-4334-ac05-eccda77b046e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-kwzpp\" (UID: \"6f946eeb-7433-4334-ac05-eccda77b046e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" Jul 28 18:02:19.470824 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc5hq\" (UniqueName: \"kubernetes.io/projected/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-kube-api-access-jc5hq\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.470824 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.470824 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-textfile\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.470824 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470488 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.470824 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470518 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f946eeb-7433-4334-ac05-eccda77b046e-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-kwzpp\" (UID: \"6f946eeb-7433-4334-ac05-eccda77b046e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" Jul 28 18:02:19.470824 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470541 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-wtmp\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.470824 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.470824 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470590 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.470824 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470589 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.470824 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:02:19.470611 2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 28 18:02:19.470824 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470630 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f946eeb-7433-4334-ac05-eccda77b046e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-kwzpp\" (UID: \"6f946eeb-7433-4334-ac05-eccda77b046e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" Jul 28 18:02:19.470824 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:02:19.470678 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-kube-state-metrics-tls podName:fe8a2803-a8b5-4d64-b11e-c48ca20264c9 nodeName:}" failed. No retries permitted until 2026-07-28 18:02:19.970660836 +0000 UTC m=+113.372205888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-zb4hk" (UID: "fe8a2803-a8b5-4d64-b11e-c48ca20264c9") : secret "kube-state-metrics-tls" not found Jul 28 18:02:19.471529 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:02:19.470697 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 28 18:02:19.471529 ip-10-0-136-117 kubenswrapper[2563]: E0728 18:02:19.470760 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f946eeb-7433-4334-ac05-eccda77b046e-openshift-state-metrics-tls podName:6f946eeb-7433-4334-ac05-eccda77b046e nodeName:}" failed. No retries permitted until 2026-07-28 18:02:19.970743048 +0000 UTC m=+113.372288106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6f946eeb-7433-4334-ac05-eccda77b046e-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-kwzpp" (UID: "6f946eeb-7433-4334-ac05-eccda77b046e") : secret "openshift-state-metrics-tls" not found Jul 28 18:02:19.471529 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470755 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/354d007d-704b-4a8f-be73-9c6cf3a681d9-metrics-client-ca\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.471529 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.470986 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-textfile\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.471529 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.471026 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.471529 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.471348 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.471791 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.471584 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.471791 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.471725 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f946eeb-7433-4334-ac05-eccda77b046e-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-kwzpp\" (UID: \"6f946eeb-7433-4334-ac05-eccda77b046e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" Jul 28 18:02:19.473316 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.473289 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.473444 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.473289 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f946eeb-7433-4334-ac05-eccda77b046e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-kwzpp\" (UID: \"6f946eeb-7433-4334-ac05-eccda77b046e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" Jul 28 18:02:19.473444 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.473344 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.483397 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.483368 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj2xt\" (UniqueName: \"kubernetes.io/projected/354d007d-704b-4a8f-be73-9c6cf3a681d9-kube-api-access-fj2xt\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.483529 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.483448 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc5hq\" (UniqueName: \"kubernetes.io/projected/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-kube-api-access-jc5hq\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.483529 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.483521 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf44s\" (UniqueName: \"kubernetes.io/projected/6f946eeb-7433-4334-ac05-eccda77b046e-kube-api-access-gf44s\") pod \"openshift-state-metrics-b8f49f5c6-kwzpp\" (UID: \"6f946eeb-7433-4334-ac05-eccda77b046e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" Jul 28 18:02:19.515812 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.515696 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:19.591646 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.591608 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:19.661439 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.661408 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:19.761889 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.761840 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:19.863039 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.863000 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:19.921690 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.921660 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:19.975017 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.974982 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f946eeb-7433-4334-ac05-eccda77b046e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-kwzpp\" (UID: \"6f946eeb-7433-4334-ac05-eccda77b046e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" Jul 28 18:02:19.975017 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.975016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.975529 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.975046 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-tls\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.977731 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.977698 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/354d007d-704b-4a8f-be73-9c6cf3a681d9-node-exporter-tls\") pod \"node-exporter-vgvp5\" (UID: \"354d007d-704b-4a8f-be73-9c6cf3a681d9\") " pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:19.977839 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.977735 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe8a2803-a8b5-4d64-b11e-c48ca20264c9-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-zb4hk\" (UID: \"fe8a2803-a8b5-4d64-b11e-c48ca20264c9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:19.977839 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:19.977794 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f946eeb-7433-4334-ac05-eccda77b046e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-kwzpp\" (UID: \"6f946eeb-7433-4334-ac05-eccda77b046e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" Jul 28 18:02:20.145674 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:20.145582 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" Jul 28 18:02:20.183834 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:20.183804 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" Jul 28 18:02:20.192013 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:20.191982 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vgvp5" Jul 28 18:02:20.208637 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:20.208224 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:20.302069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:20.302039 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp"] Jul 28 18:02:20.305442 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:02:20.305410 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f946eeb_7433_4334_ac05_eccda77b046e.slice/crio-63dd494af092f41e4edea95f81ed1b6d88b78992dfd5f02445b1448bf2438417 WatchSource:0}: Error finding container 63dd494af092f41e4edea95f81ed1b6d88b78992dfd5f02445b1448bf2438417: Status 404 returned error can't find the container with id 63dd494af092f41e4edea95f81ed1b6d88b78992dfd5f02445b1448bf2438417 Jul 28 18:02:20.307112 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:20.307086 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:20.333205 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:20.333182 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk"] Jul 28 18:02:20.335955 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:02:20.335927 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe8a2803_a8b5_4d64_b11e_c48ca20264c9.slice/crio-36576487be872a33262120bb75b551298867c748956c245775788440680d5855 WatchSource:0}: Error finding container 36576487be872a33262120bb75b551298867c748956c245775788440680d5855: Status 404 returned error can't find the container with id 36576487be872a33262120bb75b551298867c748956c245775788440680d5855 Jul 28 18:02:20.426973 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:20.426938 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:20.667493 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:20.667388 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vgvp5" event={"ID":"354d007d-704b-4a8f-be73-9c6cf3a681d9","Type":"ContainerStarted","Data":"3b0e75506884e960ae58d0a5c94bff46ed24fb3e04e5b47d3c0b0cbc50df9a75"} Jul 28 18:02:20.669318 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:20.669282 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" event={"ID":"6f946eeb-7433-4334-ac05-eccda77b046e","Type":"ContainerStarted","Data":"057f774defe6a960a62cc14d62cdb80b047f583649edbb6d60a1a12db19463a0"} Jul 28 18:02:20.669448 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:20.669354 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" event={"ID":"6f946eeb-7433-4334-ac05-eccda77b046e","Type":"ContainerStarted","Data":"1ba712c2c7e7f432005c96af7f6a963ed4abb49afb0c9baa14e490f36264e52b"} Jul 28 18:02:20.669448 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:20.669386 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" event={"ID":"6f946eeb-7433-4334-ac05-eccda77b046e","Type":"ContainerStarted","Data":"63dd494af092f41e4edea95f81ed1b6d88b78992dfd5f02445b1448bf2438417"} Jul 28 18:02:20.670416 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:20.670395 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" event={"ID":"fe8a2803-a8b5-4d64-b11e-c48ca20264c9","Type":"ContainerStarted","Data":"36576487be872a33262120bb75b551298867c748956c245775788440680d5855"} Jul 28 18:02:21.210355 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.210320 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-68d4c7996-n5rzl"] Jul 28 18:02:21.214099 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.214065 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.216812 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.216776 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 28 18:02:21.217095 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.217056 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 28 18:02:21.217220 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.217094 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 28 18:02:21.218808 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.218599 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-47zkk\"" Jul 28 18:02:21.218808 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.218627 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b18ub5fivhrji\"" Jul 28 18:02:21.218808 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.218644 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 28 18:02:21.218808 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.218703 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 28 18:02:21.227735 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.227161 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68d4c7996-n5rzl"] Jul 28 18:02:21.287679 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.287644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7vtd\" (UniqueName: \"kubernetes.io/projected/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-kube-api-access-v7vtd\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.287885 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.287698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-metrics-client-ca\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.287955 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.287913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.288007 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.287958 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.288053 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.288003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-grpc-tls\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.288053 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.288046 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-thanos-querier-tls\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.288166 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.288098 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.288217 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.288183 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.389223 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.389187 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-metrics-client-ca\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.389420 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.389281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.389420 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.389316 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.389420 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.389336 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-grpc-tls\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.389420 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.389366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-thanos-querier-tls\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.389420 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.389393 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.389749 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.389449 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.389749 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.389484 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7vtd\" (UniqueName: \"kubernetes.io/projected/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-kube-api-access-v7vtd\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.390200 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.390169 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-metrics-client-ca\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.392921 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.392889 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.392921 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.392916 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-thanos-querier-tls\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.393538 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.393508 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.393538 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.393531 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-grpc-tls\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.393678 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.393565 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.394964 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.394939 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.399631 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.399604 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7vtd\" (UniqueName: \"kubernetes.io/projected/6c546ad6-1e09-40a9-bb7b-cba9f5a60676-kube-api-access-v7vtd\") pod \"thanos-querier-68d4c7996-n5rzl\" (UID: \"6c546ad6-1e09-40a9-bb7b-cba9f5a60676\") " pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.546114 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.546079 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:21.632118 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.632094 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lwrff" Jul 28 18:02:21.677723 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.677692 2563 generic.go:356] "Generic (PLEG): container finished" podID="354d007d-704b-4a8f-be73-9c6cf3a681d9" containerID="7dc4bf3b1d61364c23c7b3d36603dcb2e7e0c320f06fa579f427ea608cf97e0d" exitCode=0 Jul 28 18:02:21.677809 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.677761 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vgvp5" event={"ID":"354d007d-704b-4a8f-be73-9c6cf3a681d9","Type":"ContainerDied","Data":"7dc4bf3b1d61364c23c7b3d36603dcb2e7e0c320f06fa579f427ea608cf97e0d"} Jul 28 18:02:21.752246 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:21.752141 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68d4c7996-n5rzl"] Jul 28 18:02:21.755468 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:02:21.755423 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c546ad6_1e09_40a9_bb7b_cba9f5a60676.slice/crio-89a24e5824bdfd6dea3374b38a31ae36eddec5ffe0484af922d64e90199f7dac WatchSource:0}: Error finding container 89a24e5824bdfd6dea3374b38a31ae36eddec5ffe0484af922d64e90199f7dac: Status 404 returned error can't find the container with id 89a24e5824bdfd6dea3374b38a31ae36eddec5ffe0484af922d64e90199f7dac Jul 28 18:02:22.188339 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:22.188242 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:22.251906 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:22.251868 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:22.316843 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:22.316814 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:22.685649 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:22.685611 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" event={"ID":"6f946eeb-7433-4334-ac05-eccda77b046e","Type":"ContainerStarted","Data":"2f288996b28f78df382a1005da9b220828c52247e2d3b624e288f1e628aa2378"} Jul 28 18:02:22.687309 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:22.687259 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" event={"ID":"6c546ad6-1e09-40a9-bb7b-cba9f5a60676","Type":"ContainerStarted","Data":"89a24e5824bdfd6dea3374b38a31ae36eddec5ffe0484af922d64e90199f7dac"} Jul 28 18:02:22.689807 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:22.689778 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" event={"ID":"fe8a2803-a8b5-4d64-b11e-c48ca20264c9","Type":"ContainerStarted","Data":"11165d74f9a95055f2d37355211e688b15589c0af18fd67a8491d790a391ec71"} Jul 28 18:02:22.689965 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:22.689839 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" event={"ID":"fe8a2803-a8b5-4d64-b11e-c48ca20264c9","Type":"ContainerStarted","Data":"1a6a68b6d4282db9c2212e3358a88851d5b88d9de71007259b156d362abe6b99"} Jul 28 18:02:22.689965 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:22.689895 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" event={"ID":"fe8a2803-a8b5-4d64-b11e-c48ca20264c9","Type":"ContainerStarted","Data":"37ee6c2ae9e8b72554c82ff2f2fa58a3d78cd9d7dd1a5c18a0b76345c979df2d"} Jul 28 18:02:22.692631 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:22.692602 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vgvp5" event={"ID":"354d007d-704b-4a8f-be73-9c6cf3a681d9","Type":"ContainerStarted","Data":"fb990e4160b17e0fea6aeab36f5df545602b30d311060d825a7d7bf676efff9f"} Jul 28 18:02:22.692746 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:22.692659 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vgvp5" event={"ID":"354d007d-704b-4a8f-be73-9c6cf3a681d9","Type":"ContainerStarted","Data":"e191edecd8b0908a591081b27858579fd629416d72006d4c2c13da7cfafacf38"} Jul 28 18:02:22.709536 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:22.709471 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kwzpp" podStartSLOduration=1.8865101709999998 podStartE2EDuration="3.709455026s" totalImagesPullingTime="1.822944855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:22.70722033 +0000 UTC m=+116.108765402" watchObservedRunningTime="2026-07-28 18:02:22.709455026 +0000 UTC m=+116.111000075" Jul 28 18:02:22.713218 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:22.713182 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:22.729550 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:22.729488 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zb4hk" podStartSLOduration=2.446035778 podStartE2EDuration="3.729467993s" totalImagesPullingTime="1.283432215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:22.728109283 +0000 UTC m=+116.129654354" watchObservedRunningTime="2026-07-28 18:02:22.729467993 +0000 UTC m=+116.131013070" Jul 28 18:02:22.749122 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:22.749059 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vgvp5" podStartSLOduration=2.69526923 podStartE2EDuration="3.749034257s" totalImagesPullingTime="973.648584ms" totalInitContainerRuntime="80.116443ms" isStatefulPod=true podCreationTimestamp="2026-07-28 18:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:22.747758446 +0000 UTC m=+116.149303533" watchObservedRunningTime="2026-07-28 18:02:22.749034257 +0000 UTC m=+116.150579333" Jul 28 18:02:23.639548 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.639512 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp"] Jul 28 18:02:23.642127 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.642099 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.645060 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.645033 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-p6zf4\"" Jul 28 18:02:23.646549 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.646524 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 18:02:23.646681 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.646636 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 28 18:02:23.646759 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.646742 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 28 18:02:23.646982 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.646960 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-eh4dh8i5qibpo\"" Jul 28 18:02:23.647110 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.646524 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 28 18:02:23.654048 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.653903 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp"] Jul 28 18:02:23.812916 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.812891 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/635e0024-3acc-44ed-992b-b3e57edbf2b2-client-ca-bundle\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.813265 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.813242 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbm6w\" (UniqueName: \"kubernetes.io/projected/635e0024-3acc-44ed-992b-b3e57edbf2b2-kube-api-access-gbm6w\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.813424 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.813287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/635e0024-3acc-44ed-992b-b3e57edbf2b2-metrics-server-audit-profiles\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.813492 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.813422 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/635e0024-3acc-44ed-992b-b3e57edbf2b2-secret-metrics-server-client-certs\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.813550 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.813492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/635e0024-3acc-44ed-992b-b3e57edbf2b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.813550 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.813540 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/635e0024-3acc-44ed-992b-b3e57edbf2b2-audit-log\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.813676 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.813640 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/635e0024-3acc-44ed-992b-b3e57edbf2b2-secret-metrics-server-tls\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.914960 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.914930 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/635e0024-3acc-44ed-992b-b3e57edbf2b2-secret-metrics-server-client-certs\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.915115 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.914984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/635e0024-3acc-44ed-992b-b3e57edbf2b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.915176 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.915157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/635e0024-3acc-44ed-992b-b3e57edbf2b2-audit-log\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.915238 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.915222 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/635e0024-3acc-44ed-992b-b3e57edbf2b2-secret-metrics-server-tls\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.915309 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.915294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/635e0024-3acc-44ed-992b-b3e57edbf2b2-client-ca-bundle\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.915360 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.915335 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbm6w\" (UniqueName: \"kubernetes.io/projected/635e0024-3acc-44ed-992b-b3e57edbf2b2-kube-api-access-gbm6w\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.915420 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.915365 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/635e0024-3acc-44ed-992b-b3e57edbf2b2-metrics-server-audit-profiles\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.915610 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.915561 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/635e0024-3acc-44ed-992b-b3e57edbf2b2-audit-log\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.915910 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.915692 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/635e0024-3acc-44ed-992b-b3e57edbf2b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.916338 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.916313 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/635e0024-3acc-44ed-992b-b3e57edbf2b2-metrics-server-audit-profiles\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.917963 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.917931 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/635e0024-3acc-44ed-992b-b3e57edbf2b2-secret-metrics-server-client-certs\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.918246 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.918227 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/635e0024-3acc-44ed-992b-b3e57edbf2b2-client-ca-bundle\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.918424 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.918401 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/635e0024-3acc-44ed-992b-b3e57edbf2b2-secret-metrics-server-tls\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.927996 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.927945 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbm6w\" (UniqueName: \"kubernetes.io/projected/635e0024-3acc-44ed-992b-b3e57edbf2b2-kube-api-access-gbm6w\") pod \"metrics-server-6ff66d7b5d-5rkjp\" (UID: \"635e0024-3acc-44ed-992b-b3e57edbf2b2\") " pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:23.957993 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:23.957954 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:24.011039 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.010998 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:24.099762 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.099723 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:24.099963 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.099794 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp"] Jul 28 18:02:24.103269 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:02:24.103236 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod635e0024_3acc_44ed_992b_b3e57edbf2b2.slice/crio-d352302860a5c7c4ca189ba24d2503223296da9c79cce13f90fde0bcd68097ad WatchSource:0}: Error finding container d352302860a5c7c4ca189ba24d2503223296da9c79cce13f90fde0bcd68097ad: Status 404 returned error can't find the container with id d352302860a5c7c4ca189ba24d2503223296da9c79cce13f90fde0bcd68097ad Jul 28 18:02:24.245174 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.245070 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:24.464443 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.464401 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-65579856ff-988kl"] Jul 28 18:02:24.466925 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.466903 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.470638 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.470002 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 18:02:24.470638 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.470057 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 18:02:24.470638 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.470080 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 18:02:24.470638 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.470014 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 18:02:24.470638 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.470012 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 18:02:24.470638 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.470407 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2sx9v\"" Jul 28 18:02:24.475994 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.475969 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 18:02:24.479993 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.479970 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65579856ff-988kl"] Jul 28 18:02:24.622114 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.622066 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-secret-telemeter-client\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.622283 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.622130 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-federate-client-tls\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.622283 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.622148 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7gnx\" (UniqueName: \"kubernetes.io/projected/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-kube-api-access-v7gnx\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.622283 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.622172 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.622283 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.622204 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-telemeter-client-tls\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.622507 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.622309 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-serving-certs-ca-bundle\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.622507 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.622357 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-metrics-client-ca\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.622507 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.622445 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.703632 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.703599 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" event={"ID":"6c546ad6-1e09-40a9-bb7b-cba9f5a60676","Type":"ContainerStarted","Data":"2a9b0d113c6d3fbbf44e2d0f0698e7e23bd61c3866a62f0f70a770eaa0913547"} Jul 28 18:02:24.703990 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.703686 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" event={"ID":"6c546ad6-1e09-40a9-bb7b-cba9f5a60676","Type":"ContainerStarted","Data":"2d6eedfcc6099e330dd837cbeeb8da029573ff192bd1a6c38b70c8cefb249e50"} Jul 28 18:02:24.703990 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.703728 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" event={"ID":"6c546ad6-1e09-40a9-bb7b-cba9f5a60676","Type":"ContainerStarted","Data":"a53af088a57efa303b9c0e2ab0758c87624a716ace9886317056385995c9941f"} Jul 28 18:02:24.704996 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.704966 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" event={"ID":"635e0024-3acc-44ed-992b-b3e57edbf2b2","Type":"ContainerStarted","Data":"d352302860a5c7c4ca189ba24d2503223296da9c79cce13f90fde0bcd68097ad"} Jul 28 18:02:24.723173 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.723147 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-metrics-client-ca\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.723251 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.723199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.723302 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.723271 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-secret-telemeter-client\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.723302 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.723294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-federate-client-tls\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.723386 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.723311 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7gnx\" (UniqueName: \"kubernetes.io/projected/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-kube-api-access-v7gnx\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.723386 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.723370 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.723480 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.723410 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-telemeter-client-tls\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.723480 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.723457 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-serving-certs-ca-bundle\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.724194 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.724146 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-serving-certs-ca-bundle\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.724295 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.724257 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-metrics-client-ca\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.724295 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.724281 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.726624 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.726599 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-secret-telemeter-client\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.726735 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.726700 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.726786 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.726755 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-telemeter-client-tls\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.727002 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.726983 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-federate-client-tls\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.733229 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.733202 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7gnx\" (UniqueName: \"kubernetes.io/projected/e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2-kube-api-access-v7gnx\") pod \"telemeter-client-65579856ff-988kl\" (UID: \"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2\") " pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.779651 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.779616 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65579856ff-988kl" Jul 28 18:02:24.832098 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.832068 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:24.934366 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.934313 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:24.974028 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:24.973989 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65579856ff-988kl"] Jul 28 18:02:24.976780 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:02:24.976743 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e43ecd_aae9_4978_91b6_71c8d2b5d9d2.slice/crio-8876fee3932ebb9de75999425dee91e53ccb12270ba9aed6575db67afb8a74df WatchSource:0}: Error finding container 8876fee3932ebb9de75999425dee91e53ccb12270ba9aed6575db67afb8a74df: Status 404 returned error can't find the container with id 8876fee3932ebb9de75999425dee91e53ccb12270ba9aed6575db67afb8a74df Jul 28 18:02:25.502898 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.502843 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:25.509507 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.509473 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:02:25.516331 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.514979 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.518265 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.518043 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 18:02:25.518265 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.518054 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 18:02:25.518475 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.518440 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2fnssssunu3vd\"" Jul 28 18:02:25.518763 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.518742 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 18:02:25.519322 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.519138 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 18:02:25.519322 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.519168 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 18:02:25.519492 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.519446 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vbv7t\"" Jul 28 18:02:25.519594 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.519494 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 18:02:25.520270 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.519707 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 18:02:25.520365 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.520273 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 18:02:25.520475 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.520457 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 18:02:25.521214 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.521186 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 18:02:25.525417 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.523958 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 18:02:25.525417 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.525027 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 18:02:25.525888 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.525844 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 18:02:25.527577 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.527556 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 18:02:25.534645 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.534620 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633408 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633437 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633462 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0bacc0b4-6c5c-4893-ac46-2034863fe853-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633508 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633570 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633603 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0bacc0b4-6c5c-4893-ac46-2034863fe853-config-out\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633631 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633654 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633702 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633733 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-web-config\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633757 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrlwr\" (UniqueName: \"kubernetes.io/projected/0bacc0b4-6c5c-4893-ac46-2034863fe853-kube-api-access-jrlwr\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.634368 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.635228 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.635228 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.633875 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.635228 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.634103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-config\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.635228 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.634149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.712674 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.712641 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65579856ff-988kl" event={"ID":"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2","Type":"ContainerStarted","Data":"8876fee3932ebb9de75999425dee91e53ccb12270ba9aed6575db67afb8a74df"} Jul 28 18:02:25.717923 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.717676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" event={"ID":"6c546ad6-1e09-40a9-bb7b-cba9f5a60676","Type":"ContainerStarted","Data":"b88172ace34f35a92dd18c22c6e4895b4b84f58ca4beb58f9d8b94fe3d8538bf"} Jul 28 18:02:25.717923 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.717761 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" event={"ID":"6c546ad6-1e09-40a9-bb7b-cba9f5a60676","Type":"ContainerStarted","Data":"2a0f825c5e1a6b81365826175aa505d73b3a28e18b12bba503432083ebb56362"} Jul 28 18:02:25.717923 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.717804 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" event={"ID":"6c546ad6-1e09-40a9-bb7b-cba9f5a60676","Type":"ContainerStarted","Data":"7d087f41c82a30343f0338bfd7f5e7bc00ada6d40f5a65ba7c359778bda396ce"} Jul 28 18:02:25.735134 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735088 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735309 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735144 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735309 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735309 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735309 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735243 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0bacc0b4-6c5c-4893-ac46-2034863fe853-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735309 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735268 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735309 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735353 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735387 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0bacc0b4-6c5c-4893-ac46-2034863fe853-config-out\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735418 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735466 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735491 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735523 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-web-config\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrlwr\" (UniqueName: \"kubernetes.io/projected/0bacc0b4-6c5c-4893-ac46-2034863fe853-kube-api-access-jrlwr\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.735600 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735584 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.736095 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.736095 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.736095 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.735693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-config\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.737358 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.737319 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.739358 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.738584 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.739514 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.739454 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.740173 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.740146 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.740575 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.740545 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.741554 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.741521 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.741945 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.741739 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.743252 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.743203 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.743956 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.743913 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.744056 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.743963 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.744315 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.744235 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.744596 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.744572 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0bacc0b4-6c5c-4893-ac46-2034863fe853-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.744704 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.744649 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.745502 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.745348 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.745724 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.745621 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-web-config\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.745724 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.745703 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-config\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.746146 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.745978 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0bacc0b4-6c5c-4893-ac46-2034863fe853-config-out\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.748108 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.747703 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.748278 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.748159 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.754472 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.751971 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrlwr\" (UniqueName: \"kubernetes.io/projected/0bacc0b4-6c5c-4893-ac46-2034863fe853-kube-api-access-jrlwr\") pod \"prometheus-k8s-0\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:25.791182 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.791115 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" podStartSLOduration=2.094267703 podStartE2EDuration="4.791091412s" totalImagesPullingTime="2.696823709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:02:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:25.787450266 +0000 UTC m=+119.188995328" watchObservedRunningTime="2026-07-28 18:02:25.791091412 +0000 UTC m=+119.192636487" Jul 28 18:02:25.838870 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:25.838812 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:26.064694 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:26.064666 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:02:26.068541 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:02:26.068501 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bacc0b4_6c5c_4893_ac46_2034863fe853.slice/crio-691459e999a345e4634312d2d0e571b2942c6b8161b0daf1a13c12ef03c0d858 WatchSource:0}: Error finding container 691459e999a345e4634312d2d0e571b2942c6b8161b0daf1a13c12ef03c0d858: Status 404 returned error can't find the container with id 691459e999a345e4634312d2d0e571b2942c6b8161b0daf1a13c12ef03c0d858 Jul 28 18:02:26.724245 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:26.724198 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bacc0b4-6c5c-4893-ac46-2034863fe853","Type":"ContainerStarted","Data":"691459e999a345e4634312d2d0e571b2942c6b8161b0daf1a13c12ef03c0d858"} Jul 28 18:02:26.726508 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:26.726088 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" event={"ID":"635e0024-3acc-44ed-992b-b3e57edbf2b2","Type":"ContainerStarted","Data":"a888f51de010c001b6d7e47bf5b03bc004228f552bc3bdfdeea3cb06cf1ba604"} Jul 28 18:02:26.726508 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:26.726446 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:26.746456 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:26.745973 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" podStartSLOduration=1.9005103380000001 podStartE2EDuration="3.745951944s" totalImagesPullingTime="1.845441606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:26.744432714 +0000 UTC m=+120.145977798" watchObservedRunningTime="2026-07-28 18:02:26.745951944 +0000 UTC m=+120.147497018" Jul 28 18:02:27.732642 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:27.732599 2563 generic.go:356] "Generic (PLEG): container finished" podID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerID="ba84dd79b860f1c0da9bc6062915dec53519db4739f1a4fc40377302e78e9b6f" exitCode=0 Jul 28 18:02:27.733233 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:27.732720 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bacc0b4-6c5c-4893-ac46-2034863fe853","Type":"ContainerDied","Data":"ba84dd79b860f1c0da9bc6062915dec53519db4739f1a4fc40377302e78e9b6f"} Jul 28 18:02:27.735631 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:27.735596 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65579856ff-988kl" event={"ID":"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2","Type":"ContainerStarted","Data":"799ac90f71427fd6c2aff456921b7504d60b3009a11a429a67849fadc5c4fb82"} Jul 28 18:02:27.735721 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:27.735662 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65579856ff-988kl" event={"ID":"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2","Type":"ContainerStarted","Data":"ddeec9f309c3d4c5b90ce615ffe8cef703ea6c3495797505107393e2846a01a1"} Jul 28 18:02:27.735721 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:27.735693 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65579856ff-988kl" event={"ID":"e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2","Type":"ContainerStarted","Data":"f6f3a0255980f0d8ae0dfdec82e2841156618e8fb1db1e156847d46643acb3f5"} Jul 28 18:02:27.789462 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:27.789360 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-65579856ff-988kl" podStartSLOduration=1.308301026 podStartE2EDuration="3.789345234s" totalImagesPullingTime="2.481044208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:02:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:27.788130021 +0000 UTC m=+121.189675091" watchObservedRunningTime="2026-07-28 18:02:27.789345234 +0000 UTC m=+121.190890306" Jul 28 18:02:29.027008 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:29.026954 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:29.121302 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:29.121267 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:29.191813 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:29.191750 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:30.626492 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:30.626438 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:30.729664 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:30.729622 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:30.827183 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:30.827137 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:31.762744 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:31.762706 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bacc0b4-6c5c-4893-ac46-2034863fe853","Type":"ContainerStarted","Data":"97d42c2a454e819f4d9571d799b25f669bae4b203d4ee8a706e3438d40740802"} Jul 28 18:02:31.763193 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:31.762794 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bacc0b4-6c5c-4893-ac46-2034863fe853","Type":"ContainerStarted","Data":"b99d2c1e12d6d2eb77201d736acc67e0fb2d8614323fa2345a4c96733e5b9f7b"} Jul 28 18:02:31.763193 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:31.762843 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bacc0b4-6c5c-4893-ac46-2034863fe853","Type":"ContainerStarted","Data":"5b0d7f1a018435027e974bfe26e70cd804da25865150942a3e9d04328754ce65"} Jul 28 18:02:31.763193 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:31.762914 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bacc0b4-6c5c-4893-ac46-2034863fe853","Type":"ContainerStarted","Data":"8d3a6ca3dffa595b72c17f48da2ba3c1e9ffbba5caf0576d3d2909578342ab26"} Jul 28 18:02:31.763193 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:31.762952 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bacc0b4-6c5c-4893-ac46-2034863fe853","Type":"ContainerStarted","Data":"4b01ff24291da48f9a69dc31a78c80ab92bc9daf871a1424ddd2fe190257a134"} Jul 28 18:02:31.763193 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:31.762986 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bacc0b4-6c5c-4893-ac46-2034863fe853","Type":"ContainerStarted","Data":"39315c7663cc32ab841ff78ba1ba01af827c57b3b7eee2fa31d63b34f9b67f66"} Jul 28 18:02:31.803471 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:31.803422 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.156995517 podStartE2EDuration="6.803403572s" totalImagesPullingTime="4.619662576s" totalInitContainerRuntime="26.745479ms" isStatefulPod=false podCreationTimestamp="2026-07-28 18:02:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:31.800588715 +0000 UTC m=+125.202133787" watchObservedRunningTime="2026-07-28 18:02:31.803403572 +0000 UTC m=+125.204948647" Jul 28 18:02:32.545377 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:32.545338 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:32.644163 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:32.644127 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:32.742069 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:32.742037 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-68d4c7996-n5rzl" Jul 28 18:02:34.623949 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:34.623916 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:35.839561 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:35.839526 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:36.945259 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:36.945227 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs\") pod \"network-metrics-daemon-8hvfx\" (UID: \"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75\") " pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:02:36.947720 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:36.947692 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75-metrics-certs\") pod \"network-metrics-daemon-8hvfx\" (UID: \"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75\") " pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:02:37.055131 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:37.055100 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8nzx7\"" Jul 28 18:02:37.062535 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:37.062509 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hvfx" Jul 28 18:02:37.203576 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:37.203550 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8hvfx"] Jul 28 18:02:37.206113 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:02:37.206085 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f14bd73_3fbf_41d1_9a93_b1a83c8f3c75.slice/crio-f74794e64f0be5ba2c3175878cebf4eb1493cf9310af48361c37816cff4db88a WatchSource:0}: Error finding container f74794e64f0be5ba2c3175878cebf4eb1493cf9310af48361c37816cff4db88a: Status 404 returned error can't find the container with id f74794e64f0be5ba2c3175878cebf4eb1493cf9310af48361c37816cff4db88a Jul 28 18:02:37.792408 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:37.792369 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8hvfx" event={"ID":"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75","Type":"ContainerStarted","Data":"f74794e64f0be5ba2c3175878cebf4eb1493cf9310af48361c37816cff4db88a"} Jul 28 18:02:37.968675 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:37.968633 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:38.068916 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:38.068801 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:38.798055 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:38.798019 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8hvfx" event={"ID":"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75","Type":"ContainerStarted","Data":"1a79b74115cd50b736d52cbf652f94ef92af400117a1cfdcfadcfb8955cd49b0"} Jul 28 18:02:38.798238 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:38.798077 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8hvfx" event={"ID":"6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75","Type":"ContainerStarted","Data":"f4820a7f00a1b219461d1b10f1164e48d3db5bb3f525c7dac6e017aa09d712ad"} Jul 28 18:02:38.819976 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:38.819918 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8hvfx" podStartSLOduration=130.662668141 podStartE2EDuration="2m11.81989951s" totalImagesPullingTime="1.157231369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:38.817920964 +0000 UTC m=+132.219466035" watchObservedRunningTime="2026-07-28 18:02:38.81989951 +0000 UTC m=+132.221444581" Jul 28 18:02:38.938525 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:38.938488 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:39.004402 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:39.004364 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:39.082138 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:39.082048 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:39.698727 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:39.698687 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:40.757756 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:40.757723 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:40.817407 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:40.817367 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:43.187792 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:43.187751 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:43.287991 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:43.287951 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:43.652606 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:43.652576 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:43.713938 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:43.713902 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:43.958776 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:43.958688 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:43.958776 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:43.958765 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:02:46.599830 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:46.599797 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:46.701466 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:46.701422 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:46.804365 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:46.804325 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:50.131957 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:50.131903 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:50.250005 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:50.249971 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:52.150340 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:52.150309 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lwrff_8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c/dns/0.log" Jul 28 18:02:52.163023 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:52.162992 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lwrff_8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c/kube-rbac-proxy/0.log" Jul 28 18:02:52.756058 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:52.756021 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:52.857079 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:52.857020 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:52.907214 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:02:52.907183 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c665d_f0b28227-f549-4efc-8400-8b6e593bdbc7/dns-node-resolver/0.log" Jul 28 18:03:03.964282 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:03.964247 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:03:03.968347 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:03.968320 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6ff66d7b5d-5rkjp" Jul 28 18:03:05.216595 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:05.216558 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:05.316162 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:05.316126 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:05.921759 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:05.921686 2563 generic.go:356] "Generic (PLEG): container finished" podID="4aa5d4d8-f114-420b-a2cc-6618e2ba3c63" containerID="dd4ee3df2fab933911c8172084dc2a25984fc5863cc99188724c9f3005f7a69f" exitCode=0 Jul 28 18:03:05.921759 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:05.921731 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" event={"ID":"4aa5d4d8-f114-420b-a2cc-6618e2ba3c63","Type":"ContainerDied","Data":"dd4ee3df2fab933911c8172084dc2a25984fc5863cc99188724c9f3005f7a69f"} Jul 28 18:03:05.922104 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:05.922083 2563 scope.go:117] "RemoveContainer" containerID="dd4ee3df2fab933911c8172084dc2a25984fc5863cc99188724c9f3005f7a69f" Jul 28 18:03:06.931668 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:06.931617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4" event={"ID":"4aa5d4d8-f114-420b-a2cc-6618e2ba3c63","Type":"ContainerStarted","Data":"8b3c16665a345aba114035ec791d06d6cf348eab367488023cc8d93b60be8548"} Jul 28 18:03:08.452370 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:08.452324 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:08.553027 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:08.552988 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:17.475147 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:17.475054 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:17.533199 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:17.533030 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:25.839488 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:25.839446 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:25.856174 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:25.856148 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:26.025586 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:26.025560 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:35.362817 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:35.362775 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:35.420629 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:35.420596 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:41.156033 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:41.155988 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:41.221512 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:41.221477 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:43.943807 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:43.943770 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:03:43.944824 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:43.944761 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="prometheus" containerID="cri-o://39315c7663cc32ab841ff78ba1ba01af827c57b3b7eee2fa31d63b34f9b67f66" gracePeriod=600 Jul 28 18:03:43.945398 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:43.945021 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="kube-rbac-proxy" containerID="cri-o://b99d2c1e12d6d2eb77201d736acc67e0fb2d8614323fa2345a4c96733e5b9f7b" gracePeriod=600 Jul 28 18:03:43.945495 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:43.945202 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="kube-rbac-proxy-thanos" containerID="cri-o://97d42c2a454e819f4d9571d799b25f669bae4b203d4ee8a706e3438d40740802" gracePeriod=600 Jul 28 18:03:43.945566 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:43.945227 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="thanos-sidecar" containerID="cri-o://8d3a6ca3dffa595b72c17f48da2ba3c1e9ffbba5caf0576d3d2909578342ab26" gracePeriod=600 Jul 28 18:03:43.945566 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:43.945249 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="kube-rbac-proxy-web" containerID="cri-o://5b0d7f1a018435027e974bfe26e70cd804da25865150942a3e9d04328754ce65" gracePeriod=600 Jul 28 18:03:43.945676 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:43.945267 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="config-reloader" containerID="cri-o://4b01ff24291da48f9a69dc31a78c80ab92bc9daf871a1424ddd2fe190257a134" gracePeriod=600 Jul 28 18:03:44.093641 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.093565 2563 generic.go:356] "Generic (PLEG): container finished" podID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerID="97d42c2a454e819f4d9571d799b25f669bae4b203d4ee8a706e3438d40740802" exitCode=0 Jul 28 18:03:44.093641 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.093590 2563 generic.go:356] "Generic (PLEG): container finished" podID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerID="b99d2c1e12d6d2eb77201d736acc67e0fb2d8614323fa2345a4c96733e5b9f7b" exitCode=0 Jul 28 18:03:44.093641 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.093596 2563 generic.go:356] "Generic (PLEG): container finished" podID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerID="5b0d7f1a018435027e974bfe26e70cd804da25865150942a3e9d04328754ce65" exitCode=0 Jul 28 18:03:44.093641 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.093602 2563 generic.go:356] "Generic (PLEG): container finished" podID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerID="8d3a6ca3dffa595b72c17f48da2ba3c1e9ffbba5caf0576d3d2909578342ab26" exitCode=0 Jul 28 18:03:44.093641 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.093610 2563 generic.go:356] "Generic (PLEG): container finished" podID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerID="4b01ff24291da48f9a69dc31a78c80ab92bc9daf871a1424ddd2fe190257a134" exitCode=0 Jul 28 18:03:44.093641 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.093619 2563 generic.go:356] "Generic (PLEG): container finished" podID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerID="39315c7663cc32ab841ff78ba1ba01af827c57b3b7eee2fa31d63b34f9b67f66" exitCode=0 Jul 28 18:03:44.093641 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.093634 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bacc0b4-6c5c-4893-ac46-2034863fe853","Type":"ContainerDied","Data":"97d42c2a454e819f4d9571d799b25f669bae4b203d4ee8a706e3438d40740802"} Jul 28 18:03:44.094148 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.093713 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bacc0b4-6c5c-4893-ac46-2034863fe853","Type":"ContainerDied","Data":"b99d2c1e12d6d2eb77201d736acc67e0fb2d8614323fa2345a4c96733e5b9f7b"} Jul 28 18:03:44.094148 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.093744 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bacc0b4-6c5c-4893-ac46-2034863fe853","Type":"ContainerDied","Data":"5b0d7f1a018435027e974bfe26e70cd804da25865150942a3e9d04328754ce65"} Jul 28 18:03:44.094148 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.093771 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bacc0b4-6c5c-4893-ac46-2034863fe853","Type":"ContainerDied","Data":"8d3a6ca3dffa595b72c17f48da2ba3c1e9ffbba5caf0576d3d2909578342ab26"} Jul 28 18:03:44.094148 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.093794 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bacc0b4-6c5c-4893-ac46-2034863fe853","Type":"ContainerDied","Data":"4b01ff24291da48f9a69dc31a78c80ab92bc9daf871a1424ddd2fe190257a134"} Jul 28 18:03:44.094148 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.093817 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bacc0b4-6c5c-4893-ac46-2034863fe853","Type":"ContainerDied","Data":"39315c7663cc32ab841ff78ba1ba01af827c57b3b7eee2fa31d63b34f9b67f66"} Jul 28 18:03:44.210285 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.210252 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:44.270048 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270015 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-tls\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270239 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270062 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-metrics-client-ca\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270239 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270093 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-kube-rbac-proxy\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270239 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270119 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-trusted-ca-bundle\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270239 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270163 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270239 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270190 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-thanos-prometheus-http-client-file\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270500 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270243 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-db\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270500 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270279 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-metrics-client-certs\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270500 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270303 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-config\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270500 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270339 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-2\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270500 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270373 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270500 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270396 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-1\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270500 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270420 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-0\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270500 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270459 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:03:44.270500 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270476 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-serving-certs-ca-bundle\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270936 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270507 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-kubelet-serving-ca-bundle\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270936 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270555 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-grpc-tls\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270936 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270603 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:03:44.270936 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270617 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrlwr\" (UniqueName: \"kubernetes.io/projected/0bacc0b4-6c5c-4893-ac46-2034863fe853-kube-api-access-jrlwr\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270936 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270702 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0bacc0b4-6c5c-4893-ac46-2034863fe853-config-out\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270936 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270733 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-web-config\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.270936 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.270771 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0bacc0b4-6c5c-4893-ac46-2034863fe853-tls-assets\") pod \"0bacc0b4-6c5c-4893-ac46-2034863fe853\" (UID: \"0bacc0b4-6c5c-4893-ac46-2034863fe853\") " Jul 28 18:03:44.271256 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.271100 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-metrics-client-ca\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.271256 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.271119 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.273405 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.271714 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:03:44.273405 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.272712 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:03:44.273405 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.273156 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:03:44.273405 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.273354 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 18:03:44.274774 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.274743 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:03:44.274904 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.274832 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:03:44.274974 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.274910 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-config" (OuterVolumeSpecName: "config") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:03:44.275028 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.274971 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bacc0b4-6c5c-4893-ac46-2034863fe853-kube-api-access-jrlwr" (OuterVolumeSpecName: "kube-api-access-jrlwr") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "kube-api-access-jrlwr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 18:03:44.275987 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.275609 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:03:44.275987 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.275681 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:03:44.276702 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.276666 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:03:44.276831 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.276798 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:03:44.277262 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.277234 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bacc0b4-6c5c-4893-ac46-2034863fe853-config-out" (OuterVolumeSpecName: "config-out") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 18:03:44.277700 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.277669 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:03:44.278323 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.278292 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:03:44.278544 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.278510 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bacc0b4-6c5c-4893-ac46-2034863fe853-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 18:03:44.278782 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.278755 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:03:44.293037 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.293000 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-web-config" (OuterVolumeSpecName: "web-config") pod "0bacc0b4-6c5c-4893-ac46-2034863fe853" (UID: "0bacc0b4-6c5c-4893-ac46-2034863fe853"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:03:44.372418 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372375 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0bacc0b4-6c5c-4893-ac46-2034863fe853-tls-assets\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372418 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372407 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372418 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372416 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-kube-rbac-proxy\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372418 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372426 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372418 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372436 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372782 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372444 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-db\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372782 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372453 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-metrics-client-certs\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372782 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372461 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-config\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372782 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372470 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372782 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372478 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372782 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372488 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372782 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372496 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372782 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372506 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372782 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372515 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bacc0b4-6c5c-4893-ac46-2034863fe853-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372782 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372525 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-secret-grpc-tls\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372782 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372533 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrlwr\" (UniqueName: \"kubernetes.io/projected/0bacc0b4-6c5c-4893-ac46-2034863fe853-kube-api-access-jrlwr\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372782 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372540 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0bacc0b4-6c5c-4893-ac46-2034863fe853-config-out\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:44.372782 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:44.372549 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0bacc0b4-6c5c-4893-ac46-2034863fe853-web-config\") on node \"ip-10-0-136-117.ec2.internal\" DevicePath \"\"" Jul 28 18:03:45.101034 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.100998 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bacc0b4-6c5c-4893-ac46-2034863fe853","Type":"ContainerDied","Data":"691459e999a345e4634312d2d0e571b2942c6b8161b0daf1a13c12ef03c0d858"} Jul 28 18:03:45.101442 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.101061 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.101442 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.101078 2563 scope.go:117] "RemoveContainer" containerID="97d42c2a454e819f4d9571d799b25f669bae4b203d4ee8a706e3438d40740802" Jul 28 18:03:45.109770 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.109751 2563 scope.go:117] "RemoveContainer" containerID="b99d2c1e12d6d2eb77201d736acc67e0fb2d8614323fa2345a4c96733e5b9f7b" Jul 28 18:03:45.119701 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.119680 2563 scope.go:117] "RemoveContainer" containerID="5b0d7f1a018435027e974bfe26e70cd804da25865150942a3e9d04328754ce65" Jul 28 18:03:45.128032 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.128005 2563 scope.go:117] "RemoveContainer" containerID="8d3a6ca3dffa595b72c17f48da2ba3c1e9ffbba5caf0576d3d2909578342ab26" Jul 28 18:03:45.129440 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.129419 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:03:45.134553 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.134532 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:03:45.136322 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.136302 2563 scope.go:117] "RemoveContainer" containerID="4b01ff24291da48f9a69dc31a78c80ab92bc9daf871a1424ddd2fe190257a134" Jul 28 18:03:45.143508 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.143491 2563 scope.go:117] "RemoveContainer" containerID="39315c7663cc32ab841ff78ba1ba01af827c57b3b7eee2fa31d63b34f9b67f66" Jul 28 18:03:45.151494 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.151477 2563 scope.go:117] "RemoveContainer" containerID="ba84dd79b860f1c0da9bc6062915dec53519db4739f1a4fc40377302e78e9b6f" Jul 28 18:03:45.168127 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168102 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:03:45.168434 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168423 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="init-config-reloader" Jul 28 18:03:45.168476 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168436 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="init-config-reloader" Jul 28 18:03:45.168476 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168450 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="kube-rbac-proxy" Jul 28 18:03:45.168476 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168456 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="kube-rbac-proxy" Jul 28 18:03:45.168476 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168469 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="config-reloader" Jul 28 18:03:45.168476 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168475 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="config-reloader" Jul 28 18:03:45.168625 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168482 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="prometheus" Jul 28 18:03:45.168625 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168487 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="prometheus" Jul 28 18:03:45.168625 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168499 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="thanos-sidecar" Jul 28 18:03:45.168625 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168504 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="thanos-sidecar" Jul 28 18:03:45.168625 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168511 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="kube-rbac-proxy-web" Jul 28 18:03:45.168625 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168516 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="kube-rbac-proxy-web" Jul 28 18:03:45.168625 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168524 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="kube-rbac-proxy-thanos" Jul 28 18:03:45.168625 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168529 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="kube-rbac-proxy-thanos" Jul 28 18:03:45.168625 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168578 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="config-reloader" Jul 28 18:03:45.168625 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168584 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="prometheus" Jul 28 18:03:45.168625 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168590 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="thanos-sidecar" Jul 28 18:03:45.168625 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168598 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="kube-rbac-proxy" Jul 28 18:03:45.168625 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168604 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="kube-rbac-proxy-web" Jul 28 18:03:45.168625 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.168610 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" containerName="kube-rbac-proxy-thanos" Jul 28 18:03:45.174250 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.174228 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.177499 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.177477 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 18:03:45.177628 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.177477 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 18:03:45.177628 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.177478 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 18:03:45.177628 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.177477 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 18:03:45.177628 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.177477 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 18:03:45.177899 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.177882 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 18:03:45.177957 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.177889 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 18:03:45.177957 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.177941 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2fnssssunu3vd\"" Jul 28 18:03:45.178152 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.178135 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 18:03:45.178219 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.178157 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 18:03:45.178219 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.178136 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vbv7t\"" Jul 28 18:03:45.178219 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.178142 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 18:03:45.178219 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.178210 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 18:03:45.178463 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.178446 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 18:03:45.181198 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.181177 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 18:03:45.183349 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.183330 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 18:03:45.191362 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.191337 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:03:45.235202 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.235113 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bacc0b4-6c5c-4893-ac46-2034863fe853" path="/var/lib/kubelet/pods/0bacc0b4-6c5c-4893-ac46-2034863fe853/volumes" Jul 28 18:03:45.279457 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279423 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279593 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279460 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279593 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279593 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279553 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-config\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279720 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279594 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279720 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279616 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279720 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279640 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279720 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279656 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279720 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279681 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279720 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279702 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pzqp\" (UniqueName: \"kubernetes.io/projected/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-kube-api-access-9pzqp\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279978 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279730 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279978 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279773 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279978 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279796 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279978 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279818 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279978 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279838 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279978 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279883 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279978 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279978 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279978 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279941 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.279978 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.279954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.380862 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.380813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.380862 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.380864 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381103 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.380986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381103 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381103 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381064 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381103 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381080 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381103 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381360 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381148 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381360 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381171 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381360 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381209 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381360 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-config\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381360 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381306 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381360 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381330 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381694 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381694 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381389 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381694 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381413 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381694 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381440 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pzqp\" (UniqueName: \"kubernetes.io/projected/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-kube-api-access-9pzqp\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381694 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381493 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381694 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381508 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.381694 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381527 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.382246 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.381815 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.382246 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.382053 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.382346 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.382263 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.382897 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.382828 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.384896 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.383882 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.384896 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.383966 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.384896 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.383990 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.384896 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.384251 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.384896 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.384831 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.384896 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.384877 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.385318 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.385261 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-config\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.386136 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.386110 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.386589 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.386556 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.386995 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.386961 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.387110 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.387090 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.387656 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.387624 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.387745 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.387729 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.387921 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.387904 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.388524 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.388505 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.394178 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.394159 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pzqp\" (UniqueName: \"kubernetes.io/projected/d67b8936-69c4-42e5-9fe7-01e4fa8749f9-kube-api-access-9pzqp\") pod \"prometheus-k8s-0\" (UID: \"d67b8936-69c4-42e5-9fe7-01e4fa8749f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.484640 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.484600 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:45.642296 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:45.642268 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:03:45.643981 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:03:45.643954 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67b8936_69c4_42e5_9fe7_01e4fa8749f9.slice/crio-61312fd4ffa8359d25843f4c4068e0c46ed0110c751caa749adeadc6515dd6f6 WatchSource:0}: Error finding container 61312fd4ffa8359d25843f4c4068e0c46ed0110c751caa749adeadc6515dd6f6: Status 404 returned error can't find the container with id 61312fd4ffa8359d25843f4c4068e0c46ed0110c751caa749adeadc6515dd6f6 Jul 28 18:03:46.108193 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:46.108151 2563 generic.go:356] "Generic (PLEG): container finished" podID="d67b8936-69c4-42e5-9fe7-01e4fa8749f9" containerID="ebd02e89748884230d78f01e61bd37c6bcb4c43845b8131facdfa698ad6517ae" exitCode=0 Jul 28 18:03:46.108618 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:46.108236 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d67b8936-69c4-42e5-9fe7-01e4fa8749f9","Type":"ContainerDied","Data":"ebd02e89748884230d78f01e61bd37c6bcb4c43845b8131facdfa698ad6517ae"} Jul 28 18:03:46.108618 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:46.108334 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d67b8936-69c4-42e5-9fe7-01e4fa8749f9","Type":"ContainerStarted","Data":"61312fd4ffa8359d25843f4c4068e0c46ed0110c751caa749adeadc6515dd6f6"} Jul 28 18:03:47.116026 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:47.115980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d67b8936-69c4-42e5-9fe7-01e4fa8749f9","Type":"ContainerStarted","Data":"4beec59cd57c56c4b085966bbd45a63e821a954e1a462d5097f64f89edc09854"} Jul 28 18:03:47.116467 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:47.116063 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d67b8936-69c4-42e5-9fe7-01e4fa8749f9","Type":"ContainerStarted","Data":"2f823c21a3635a164bd5f7ed1bfe30bf4054fecf5f631454c89631d91b08fbcf"} Jul 28 18:03:47.116467 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:47.116104 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d67b8936-69c4-42e5-9fe7-01e4fa8749f9","Type":"ContainerStarted","Data":"c413b21b19664f712e0fabb53b82762c383e6431ed773c962aec7277f27cb93a"} Jul 28 18:03:47.116467 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:47.116143 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d67b8936-69c4-42e5-9fe7-01e4fa8749f9","Type":"ContainerStarted","Data":"70c03b191f4dddd19c8bdbab1a8dd4486177ad9bfd9615c7882a747a91a7869d"} Jul 28 18:03:47.116467 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:47.116181 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d67b8936-69c4-42e5-9fe7-01e4fa8749f9","Type":"ContainerStarted","Data":"6df658b117163eeda225477843ef5964cd0157868350359cdc9ed1e0396cce9e"} Jul 28 18:03:47.116467 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:47.116219 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d67b8936-69c4-42e5-9fe7-01e4fa8749f9","Type":"ContainerStarted","Data":"b191b4f000758e31968a965bc5d4e79c670d184ee5eeb6b5cec4c02209d0a0a7"} Jul 28 18:03:47.158299 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:47.158238 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.134202499 podStartE2EDuration="2.158218878s" totalImagesPullingTime="0s" totalInitContainerRuntime="24.016379ms" isStatefulPod=false podCreationTimestamp="2026-07-28 18:03:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:03:47.155076587 +0000 UTC m=+200.556621659" watchObservedRunningTime="2026-07-28 18:03:47.158218878 +0000 UTC m=+200.559763949" Jul 28 18:03:50.485280 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:50.485225 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:50.548158 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:50.548116 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:50.622122 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:50.622086 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:52.029244 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:52.029194 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:52.132530 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:52.132462 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:52.246590 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:03:52.246549 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:05.142089 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:04:05.142049 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:05.243371 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:04:05.243337 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:10.767385 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:04:10.767341 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:22.349070 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:04:22.349029 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:22.415362 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:04:22.415324 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:45.485797 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:04:45.485749 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:04:45.502598 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:04:45.502567 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:04:46.373236 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:04:46.373205 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:04:55.424215 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:04:55.424158 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:55.486625 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:04:55.486592 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:05:08.351157 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:08.351114 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:05:15.301189 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:15.301142 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:05:15.471990 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:15.471951 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:05:15.574596 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:15.574505 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:05:18.167778 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:18.167748 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4jk9v_2303d131-0afd-44ba-9f4e-75ded817669c/global-pull-secret-syncer/0.log" Jul 28 18:05:18.339515 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:18.339489 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" Jul 28 18:05:18.471677 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:18.471578 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-117.ec2.internal_e3c64a3cbc978c2ce69fb398febfaea2/haproxy/0.log" Jul 28 18:05:21.256208 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:21.256160 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:05:21.333309 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:21.333268 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:05:22.108551 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:22.108516 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-zb4hk_fe8a2803-a8b5-4d64-b11e-c48ca20264c9/kube-state-metrics/0.log" Jul 28 18:05:22.144630 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:22.144593 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-zb4hk_fe8a2803-a8b5-4d64-b11e-c48ca20264c9/kube-rbac-proxy-main/0.log" Jul 28 18:05:22.182233 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:22.182206 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-zb4hk_fe8a2803-a8b5-4d64-b11e-c48ca20264c9/kube-rbac-proxy-self/0.log" Jul 28 18:05:22.242688 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:22.242651 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6ff66d7b5d-5rkjp_635e0024-3acc-44ed-992b-b3e57edbf2b2/metrics-server/0.log" Jul 28 18:05:22.612038 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:22.612006 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vgvp5_354d007d-704b-4a8f-be73-9c6cf3a681d9/node-exporter/0.log" Jul 28 18:05:22.643907 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:22.643877 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vgvp5_354d007d-704b-4a8f-be73-9c6cf3a681d9/kube-rbac-proxy/0.log" Jul 28 18:05:22.706540 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:22.706515 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vgvp5_354d007d-704b-4a8f-be73-9c6cf3a681d9/init-textfile/0.log" Jul 28 18:05:22.765949 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:22.765924 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-kwzpp_6f946eeb-7433-4334-ac05-eccda77b046e/kube-rbac-proxy-main/0.log" Jul 28 18:05:22.823812 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:22.823740 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-kwzpp_6f946eeb-7433-4334-ac05-eccda77b046e/kube-rbac-proxy-self/0.log" Jul 28 18:05:22.865519 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:22.865488 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-kwzpp_6f946eeb-7433-4334-ac05-eccda77b046e/openshift-state-metrics/0.log" Jul 28 18:05:22.929804 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:22.929761 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d67b8936-69c4-42e5-9fe7-01e4fa8749f9/prometheus/0.log" Jul 28 18:05:22.989430 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:22.989401 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d67b8936-69c4-42e5-9fe7-01e4fa8749f9/config-reloader/0.log" Jul 28 18:05:23.070194 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.070159 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d67b8936-69c4-42e5-9fe7-01e4fa8749f9/thanos-sidecar/0.log" Jul 28 18:05:23.113670 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.113591 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d67b8936-69c4-42e5-9fe7-01e4fa8749f9/kube-rbac-proxy-web/0.log" Jul 28 18:05:23.149519 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.149488 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d67b8936-69c4-42e5-9fe7-01e4fa8749f9/kube-rbac-proxy/0.log" Jul 28 18:05:23.188944 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.188918 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d67b8936-69c4-42e5-9fe7-01e4fa8749f9/kube-rbac-proxy-thanos/0.log" Jul 28 18:05:23.224570 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.224549 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d67b8936-69c4-42e5-9fe7-01e4fa8749f9/init-config-reloader/0.log" Jul 28 18:05:23.274478 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.274452 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-dn7nx_461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11/prometheus-operator/0.log" Jul 28 18:05:23.327615 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.327582 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-dn7nx_461779e0-d8c8-4d0f-8e5b-e55f5bdaaa11/kube-rbac-proxy/0.log" Jul 28 18:05:23.374332 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.374254 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-2qrv2_6714a25c-5a51-462e-9caf-799337cb5695/prometheus-operator-admission-webhook/0.log" Jul 28 18:05:23.451348 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.451316 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65579856ff-988kl_e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2/telemeter-client/0.log" Jul 28 18:05:23.490249 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.490216 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65579856ff-988kl_e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2/reload/0.log" Jul 28 18:05:23.535065 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.535029 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65579856ff-988kl_e8e43ecd-aae9-4978-91b6-71c8d2b5d9d2/kube-rbac-proxy/0.log" Jul 28 18:05:23.590590 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.590567 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d4c7996-n5rzl_6c546ad6-1e09-40a9-bb7b-cba9f5a60676/thanos-query/0.log" Jul 28 18:05:23.635124 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.635046 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d4c7996-n5rzl_6c546ad6-1e09-40a9-bb7b-cba9f5a60676/kube-rbac-proxy-web/0.log" Jul 28 18:05:23.677968 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.677932 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d4c7996-n5rzl_6c546ad6-1e09-40a9-bb7b-cba9f5a60676/kube-rbac-proxy/0.log" Jul 28 18:05:23.748088 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.748058 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d4c7996-n5rzl_6c546ad6-1e09-40a9-bb7b-cba9f5a60676/prom-label-proxy/0.log" Jul 28 18:05:23.803201 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.803166 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d4c7996-n5rzl_6c546ad6-1e09-40a9-bb7b-cba9f5a60676/kube-rbac-proxy-rules/0.log" Jul 28 18:05:23.840006 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:23.839979 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d4c7996-n5rzl_6c546ad6-1e09-40a9-bb7b-cba9f5a60676/kube-rbac-proxy-metrics/0.log" Jul 28 18:05:25.464240 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.464198 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6p8v5_9d515405-8064-4166-900b-d92ea2405bc3/konnectivity-agent/0.log" limit=1024 Jul 28 18:05:25.565983 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.565953 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bkjc4_a75f7c77-0525-45d0-b2e4-f0961bb7a096/console-operator/1.log" Jul 28 18:05:25.572815 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.572788 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bkjc4_a75f7c77-0525-45d0-b2e4-f0961bb7a096/console-operator/2.log" Jul 28 18:05:25.576082 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.576056 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh"] Jul 28 18:05:25.579629 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.579610 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.582965 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.582944 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c9fjg\"/\"kube-root-ca.crt\"" Jul 28 18:05:25.584279 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.584258 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c9fjg\"/\"openshift-service-ca.crt\"" Jul 28 18:05:25.584392 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.584274 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c9fjg\"/\"default-dockercfg-t6dbd\"" Jul 28 18:05:25.596597 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.596570 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh"] Jul 28 18:05:25.701536 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.701495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b94840fc-2508-4695-a21e-395ef71e0dd8-proc\") pod \"perf-node-gather-daemonset-j5hjh\" (UID: \"b94840fc-2508-4695-a21e-395ef71e0dd8\") " pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.701722 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.701547 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b94840fc-2508-4695-a21e-395ef71e0dd8-lib-modules\") pod \"perf-node-gather-daemonset-j5hjh\" (UID: \"b94840fc-2508-4695-a21e-395ef71e0dd8\") " pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.701722 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.701609 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rjmd\" (UniqueName: \"kubernetes.io/projected/b94840fc-2508-4695-a21e-395ef71e0dd8-kube-api-access-2rjmd\") pod \"perf-node-gather-daemonset-j5hjh\" (UID: \"b94840fc-2508-4695-a21e-395ef71e0dd8\") " pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.701722 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.701655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b94840fc-2508-4695-a21e-395ef71e0dd8-podres\") pod \"perf-node-gather-daemonset-j5hjh\" (UID: \"b94840fc-2508-4695-a21e-395ef71e0dd8\") " pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.701829 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.701724 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b94840fc-2508-4695-a21e-395ef71e0dd8-sys\") pod \"perf-node-gather-daemonset-j5hjh\" (UID: \"b94840fc-2508-4695-a21e-395ef71e0dd8\") " pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.802362 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.802326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b94840fc-2508-4695-a21e-395ef71e0dd8-lib-modules\") pod \"perf-node-gather-daemonset-j5hjh\" (UID: \"b94840fc-2508-4695-a21e-395ef71e0dd8\") " pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.802362 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.802372 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rjmd\" (UniqueName: \"kubernetes.io/projected/b94840fc-2508-4695-a21e-395ef71e0dd8-kube-api-access-2rjmd\") pod \"perf-node-gather-daemonset-j5hjh\" (UID: \"b94840fc-2508-4695-a21e-395ef71e0dd8\") " pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.802588 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.802399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b94840fc-2508-4695-a21e-395ef71e0dd8-podres\") pod \"perf-node-gather-daemonset-j5hjh\" (UID: \"b94840fc-2508-4695-a21e-395ef71e0dd8\") " pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.802588 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.802449 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b94840fc-2508-4695-a21e-395ef71e0dd8-sys\") pod \"perf-node-gather-daemonset-j5hjh\" (UID: \"b94840fc-2508-4695-a21e-395ef71e0dd8\") " pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.802588 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.802500 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b94840fc-2508-4695-a21e-395ef71e0dd8-proc\") pod \"perf-node-gather-daemonset-j5hjh\" (UID: \"b94840fc-2508-4695-a21e-395ef71e0dd8\") " pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.802588 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.802509 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b94840fc-2508-4695-a21e-395ef71e0dd8-lib-modules\") pod \"perf-node-gather-daemonset-j5hjh\" (UID: \"b94840fc-2508-4695-a21e-395ef71e0dd8\") " pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.802588 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.802561 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b94840fc-2508-4695-a21e-395ef71e0dd8-sys\") pod \"perf-node-gather-daemonset-j5hjh\" (UID: \"b94840fc-2508-4695-a21e-395ef71e0dd8\") " pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.802588 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.802581 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b94840fc-2508-4695-a21e-395ef71e0dd8-proc\") pod \"perf-node-gather-daemonset-j5hjh\" (UID: \"b94840fc-2508-4695-a21e-395ef71e0dd8\") " pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.802794 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.802586 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b94840fc-2508-4695-a21e-395ef71e0dd8-podres\") pod \"perf-node-gather-daemonset-j5hjh\" (UID: \"b94840fc-2508-4695-a21e-395ef71e0dd8\") " pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.814690 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.814665 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rjmd\" (UniqueName: \"kubernetes.io/projected/b94840fc-2508-4695-a21e-395ef71e0dd8-kube-api-access-2rjmd\") pod \"perf-node-gather-daemonset-j5hjh\" (UID: \"b94840fc-2508-4695-a21e-395ef71e0dd8\") " pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:25.889275 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:25.889238 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:26.047979 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:26.047950 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh"] Jul 28 18:05:26.050565 ip-10-0-136-117 kubenswrapper[2563]: W0728 18:05:26.050540 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb94840fc_2508_4695_a21e_395ef71e0dd8.slice/crio-9f0e24529ca1b6c3ad9f6dfe918985128a3232738c6189d9395fd92984cd4ea6 WatchSource:0}: Error finding container 9f0e24529ca1b6c3ad9f6dfe918985128a3232738c6189d9395fd92984cd4ea6: Status 404 returned error can't find the container with id 9f0e24529ca1b6c3ad9f6dfe918985128a3232738c6189d9395fd92984cd4ea6 Jul 28 18:05:26.528410 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:26.528368 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" event={"ID":"b94840fc-2508-4695-a21e-395ef71e0dd8","Type":"ContainerStarted","Data":"9145412bcf8e80d3a22e3c4e5eeccc474995a6979f7156d674b2794c55030666"} Jul 28 18:05:26.528937 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:26.528428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" event={"ID":"b94840fc-2508-4695-a21e-395ef71e0dd8","Type":"ContainerStarted","Data":"9f0e24529ca1b6c3ad9f6dfe918985128a3232738c6189d9395fd92984cd4ea6"} Jul 28 18:05:26.528937 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:26.528506 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:26.555369 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:26.555317 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" podStartSLOduration=1.555299416 podStartE2EDuration="1.555299416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:05:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:05:26.553741569 +0000 UTC m=+299.955286631" watchObservedRunningTime="2026-07-28 18:05:26.555299416 +0000 UTC m=+299.956844487" Jul 28 18:05:26.680843 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:26.680813 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-6br56_5658cf68-03a2-48cb-bbb7-4196673cc9ab/volume-data-source-validator/0.log" Jul 28 18:05:27.000830 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:27.000729 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bkjc4_a75f7c77-0525-45d0-b2e4-f0961bb7a096/console-operator/1.log" Jul 28 18:05:27.004836 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:27.004805 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bkjc4_a75f7c77-0525-45d0-b2e4-f0961bb7a096/console-operator/1.log" Jul 28 18:05:27.013159 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:27.013133 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 18:05:27.775871 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:27.775817 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lwrff_8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c/dns/0.log" Jul 28 18:05:27.807195 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:27.807166 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lwrff_8e3ef4f9-ddf8-4714-85e5-7f680dc5f81c/kube-rbac-proxy/0.log" Jul 28 18:05:27.945745 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:27.945712 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c665d_f0b28227-f549-4efc-8400-8b6e593bdbc7/dns-node-resolver/0.log" Jul 28 18:05:28.581082 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:28.581050 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vkfbb_985f20a7-3708-4e65-813e-6c35a729145e/node-ca/0.log" Jul 28 18:05:29.447907 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:29.447880 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-89f454f45-wmkhj_b957e2bd-d3d7-44ff-8556-b990cb83c073/router/0.log" Jul 28 18:05:29.892191 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:29.892162 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nshmr_1443152a-ab29-4506-b24d-820dbe81be9c/serve-healthcheck-canary/0.log" Jul 28 18:05:30.421453 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:30.421427 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5zgrr_8b16c371-448e-4258-b151-a12361f67bfe/kube-rbac-proxy/0.log" Jul 28 18:05:30.457615 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:30.457578 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5zgrr_8b16c371-448e-4258-b151-a12361f67bfe/exporter/0.log" Jul 28 18:05:30.499431 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:30.499404 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5zgrr_8b16c371-448e-4258-b151-a12361f67bfe/extractor/0.log" Jul 28 18:05:32.542116 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:32.542082 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c9fjg/perf-node-gather-daemonset-j5hjh" Jul 28 18:05:35.622969 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:35.622873 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-qzh2g_e9245fcb-a04f-4d4f-987d-9f8292c72e9c/migrator/0.log" Jul 28 18:05:35.666191 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:35.666159 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-qzh2g_e9245fcb-a04f-4d4f-987d-9f8292c72e9c/graceful-termination/0.log" Jul 28 18:05:36.041643 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:36.041616 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4_4aa5d4d8-f114-420b-a2cc-6618e2ba3c63/kube-storage-version-migrator-operator/1.log" Jul 28 18:05:36.043220 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:36.043190 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-x2mr4_4aa5d4d8-f114-420b-a2cc-6618e2ba3c63/kube-storage-version-migrator-operator/0.log" Jul 28 18:05:37.353397 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:37.353369 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kd6vz_9bd5a65a-bedf-4de1-a07a-610d3521385e/kube-multus-additional-cni-plugins/0.log" Jul 28 18:05:37.384669 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:37.384639 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kd6vz_9bd5a65a-bedf-4de1-a07a-610d3521385e/egress-router-binary-copy/0.log" Jul 28 18:05:37.416283 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:37.416247 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kd6vz_9bd5a65a-bedf-4de1-a07a-610d3521385e/cni-plugins/0.log" Jul 28 18:05:37.447641 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:37.447615 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kd6vz_9bd5a65a-bedf-4de1-a07a-610d3521385e/bond-cni-plugin/0.log" Jul 28 18:05:37.477261 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:37.477179 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kd6vz_9bd5a65a-bedf-4de1-a07a-610d3521385e/routeoverride-cni/0.log" Jul 28 18:05:37.510484 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:37.510455 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kd6vz_9bd5a65a-bedf-4de1-a07a-610d3521385e/whereabouts-cni-bincopy/0.log" Jul 28 18:05:37.548581 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:37.548544 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kd6vz_9bd5a65a-bedf-4de1-a07a-610d3521385e/whereabouts-cni/0.log" Jul 28 18:05:37.830291 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:37.830253 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t8vxl_afc30e7e-46f4-4447-a054-5c4a81f1ce0a/kube-multus/0.log" Jul 28 18:05:37.917268 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:37.917234 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8hvfx_6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75/network-metrics-daemon/0.log" Jul 28 18:05:37.946269 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:37.946242 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8hvfx_6f14bd73-3fbf-41d1-9a93-b1a83c8f3c75/kube-rbac-proxy/0.log" Jul 28 18:05:38.845907 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:38.845876 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6qr4_9a3698e5-4a71-4928-a854-28b89fcebe5f/ovn-controller/0.log" Jul 28 18:05:38.882755 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:38.882726 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6qr4_9a3698e5-4a71-4928-a854-28b89fcebe5f/ovn-acl-logging/0.log" Jul 28 18:05:38.920324 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:38.920291 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6qr4_9a3698e5-4a71-4928-a854-28b89fcebe5f/kube-rbac-proxy-node/0.log" Jul 28 18:05:38.950709 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:38.950670 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6qr4_9a3698e5-4a71-4928-a854-28b89fcebe5f/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 18:05:38.977913 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:38.977888 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6qr4_9a3698e5-4a71-4928-a854-28b89fcebe5f/northd/0.log" Jul 28 18:05:39.011771 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:39.011739 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6qr4_9a3698e5-4a71-4928-a854-28b89fcebe5f/nbdb/0.log" Jul 28 18:05:39.044245 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:39.044211 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6qr4_9a3698e5-4a71-4928-a854-28b89fcebe5f/sbdb/0.log" Jul 28 18:05:39.109255 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:39.109176 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s6qr4_9a3698e5-4a71-4928-a854-28b89fcebe5f/ovnkube-controller/0.log" Jul 28 18:05:40.751423 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:40.751395 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-bzrdk_c3f3a583-1527-44a1-b22e-298a09afffdc/network-check-target-container/0.log" Jul 28 18:05:41.871491 ip-10-0-136-117 kubenswrapper[2563]: I0728 18:05:41.871461 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-rrw2c_9c1cfedf-04f8-457f-bb58-e982eea0dd6f/iptables-alerter/0.log"